Joe Schmoe LLC will probably do just fine by sticking to popular clouds. I reckon adopting Oxide Computer would pay off at much larger volumes of traffic, or if you have to do on-prem due to regulatory reasons.
It would be nice to know more about pricing so the Enthusiast Joe can have a better idea, but it's more a boutique vibe right now.
Putting together bits and pieces from different sources: a half-rack is the minimum SKU, and it has 1024 cores and 16 TiB RAM for somewhere around $600k. (So many people have repeated the latter number that it must be true! I.e., add salt grains to taste.)
Just the thing for an ambitious enthusiast to upgrade to from their Raspberry Pi rack!
Very good point. That number almost certainly doesn't take into account recent RAM price increases, etc.
Tracing back through all the multitude of references to the $600k price, the earliest I found was from 2023, and it's completely unsourced: https://news.ycombinator.com/item?id=38498840
Bryan gave a talk in Jane Street (you can find them in their Youtube channel). In there, he clearly was talking about a production issue that was happening to the Oxide rack from inside Jane Street. So yes, I am pretty they sold a rack to Jane Street.
It seems like Jane street and lawrence national laboratory are two confirmed customers.