Where is all the power going to come from for AI/ML

[Vastris31]

AI/ML consume power like it's an unlimited resource and it isn't. I feel a combination of power saving technologies on the semiconductor end and small modular nuclear power plants like we have in submarines and aircraft carriers will be the best answer to this current and coming challenge. Also, will the cost of power be the next driver of increasing cost for using AI/ML. Any thoughts or comments appreciated. With TSM going full blast on production, this is a critical question for the future of the semi industry as a whole.

You're totally right about AI/ML systems eating up a lot of power. Making semiconductors more efficient is super important to help with that. Pairing those advancements with small modular nuclear reactors, like the ones used in submarines, could be a great way to handle the energy needs. The cost of power will probably start affecting the overall cost of using AI/ML too. With companies like TSMC ramping up production, it's crucial to focus on energy efficiency and look into alternative power sources to keep things sustainable.

 

[Xebec]

The first good news I've seen about US nuclear power in a long time:

https://www.cnbc.com/2024/05/29/white-house-to-support-new-nuclear-power-plants-in-the-us.html

Of course, I am waiting to see if Biden really does this, once the Congressional Progressive Caucus complains about it.

This is great news!

I wonder how bad the shortage of nuclear engineers is to build nuclear back up in the US. I have a (much older) retired friend who was able (or at least appeared to be) to command all kinds of consulting money because of his experience in running nuclear plants.

I see a strong strategic security / defense argument for more nuclear plants.

 

[blueone]

I wonder how bad the shortage of nuclear engineers is to build nuclear back up in the US. I have a (much older) retired friend who was able (or at least appeared to be) to command all kinds of consulting money because of his experience in running nuclear plants.

This is a very valid concern. Many experts have said that now the nuclear plant Vogtle in Georgia is online, the US needs to deploy the engineers who gained the experience to build other nuclear plants. Unfortunately, there are no shovel-ready projects approved in the US, and sentiment from environmentalists is strongly against any new nuclear plant approvals. China, on the other hand, has 23 nuclear projects under construction.