This gets posted regularly on Lemmy, and while the economic take is tone-deaf at best, there’s a real issue with generating more power than you can use. You can’t just dump grid power — it needs to go somewhere. The grid needs to consume as much as it generates at all times or else bad things happen.
There are of course solutions, but that doesn’t mean it’s not an engineering challenge to implement.
Figuring out what to do with kilowatts is easy, but figuring out what to do with megawatts, at the drop of a hat, is substantially harder.
Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.
This gets posted regularly on Lemmy, and while the economic take is tone-deaf at best, there’s a real issue with generating more power than you can use. You can’t just dump grid power — it needs to go somewhere. The grid needs to consume as much as it generates at all times or else bad things happen.
There are of course solutions, but that doesn’t mean it’s not an engineering challenge to implement.
Figuring out what to do with kilowatts is easy, but figuring out what to do with megawatts, at the drop of a hat, is substantially harder.
I thought by this year we would’ve figured out a way to store solar energy the same way we store tanks of food/water. Like a big ol battery
Peak energy production would be a good time to train the damn llms instead of building natural gas power plant I guess.
Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.