There are definitely datacenters that aren’t live due to power hookups. Is the idea that we should precisely time both? I think everyone would love to do that. To the extent that GPUs are not in production, it’s not because they could be and are not so. Literally everyone who buys them is trying to put them into production because they’re as close to a money printer as one can legally have. The operating margins on a running GPU are incredible.
Even my old RTX 6000 Pros would be profitable if I rented them out.
That's the usual approach yes. You want to have equipment you buy show up where it's going to be installed, installed and activated in as short a time possible. You don't want to have it sit in a warehouse for 6 months while you try to get permission to break ground because, in a normal market, the equipment will be losing value during that time.
That’s the dream (which is what I meant by “everyone would love to do that”), but what you gain in the cost of money you lose as demand eats into supply ahead of you.
Right now, the lead time of these racks is like 36 weeks and they’ll want payment down unless they’re sure you’re good for it which is in the $100m range. You just try to get them as soon as you can because and when the integrator and Nvidia can get them to you.
I don’t understand what the problem is here. You think they’re damaging their own economics on purpose? Every time I’ve been involved in hardware procurement, it’s been the case that you try to get things as fast as possible on everything because you never know which seemingly fixed lead time suddenly clears.
If you intentionally bake in delays you’re guaranteed to not make it work, esp. in a demand crunch. My GPUs are SMB/prosumer range and even they are much harder to get now. The smartest thing I did was lock in my purchases in January. If I had been unable to negotiate the rack space it would have been suboptimal but if I had decided to wait for guaranteed time I would have been screwed. As it so happens I should have gone to 2TB VRAM instead of aiming low.
This is the calculus that all businesses are facing, not just mine.
Even my old RTX 6000 Pros would be profitable if I rented them out.