I think this also suggests that it is possible to host high-quality models on the edge. I did a rough calculation, and the potential savings could be significant. This raises the question of whether we truly need substantial capital spending, especially if test-time compute—currently the focus—can be performed on the edge. If so, the need for extensive infrastructure build-out would be reduced.
I am not a fan of the Stargate project. I suspect that, in the interest of speed and cost-effectiveness, they might find it logical to construct fossil fuel-based generation to power the data centers. However, I find it absurd that we are planning to expend such an enormous amount of energy and carbon emissions on trivial activities, such as planning holidays, dinner arrangements, etc. Anyway, that’s just my opinion.
www.linkedin.com
