If running at home on a beefy video game setup, it's ~200watts or probably in the area of $100/year.
But you're not using it at full blast 24x7 most likely. You could be servicing a ton of people on that $100.
Now the big cloud AI will be using more power than that, and also have engineers for better efficiency. More efficient AI cards will be used. When chatgpt charges $20/month. They are covering all the electrical costs for sure.
But you're not using it at full blast 24x7 most likely. You could be servicing a ton of people on that $100.
Now the big cloud AI will be using more power than that, and also have engineers for better efficiency. More efficient AI cards will be used. When chatgpt charges $20/month. They are covering all the electrical costs for sure.