Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.
Peak energy production would be a good time to train the damn llms instead of building natural gas power plant I guess.
Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.