So, 95% GPU rented sits idle? Enterprises are having a real FOMO as AI usage keeps growing but ju…

📰

So, 95% GPU rented sits idle? Enterprises are having a real FOMO as AI usage keeps growing but just not on their platform

Reddit r/kubernetes·u/ocean_protocol·about 1 month ago

Reading 0:00

15s threshold

Well, if everyone has the most idle silicon, where are the jobs?

Did the companies overprovisioned due to hype? or just to keep up with big AI companies and hoping for usage while they didn't get that?

This is a waste on so many levels. I mean, first, they pre-book the supply, causing shortages for others, and then bills go up even with no usage.

I think there should really exist a pay-per-use billing method or at least reduce cost if idle.

Also, Do we really need more data centers or just better efficient methods to utilise already sitting GPU capacity?