But, Doctor, the data does back that up. The US middle class is shrinking, and most of the shrinkage is on the low end. There's no mystery about this, only potential for distractions.
There is an interesting question - how can we prove paternity or other DNA based questions with identical twins (full sequencing looking for mutations?) and if we can't, how do we handle legal responsibilities in this sort of case?
no there isn't but i appreciate your amusing stupidity. this is a good example of the state of exception that most people with common sense intuitively understand.
Assuming 80GB H100 and you inference a model that is MoE and close to the size of the 80GB VRAM, you're going to see around 10k tokens/second fully batched and saturated. An example here might be Mixtral 8x7B.
You're generating about 36 million tokens/hour. Cost of Mixtral 8x7b on Open router is $0.54/M input tokens. $0.54/M output tokens.
You're looking at potentially $38.88/hour return on that H100 GPU. This is probably the best case scenario.
In reality, inference providers will use multiple GPUs together to run bigger, smarter models for a higher price.
3.99 at 8x instances, with a minimum 2 week commitment. Good luck getting 70% usage average during that time. Useful when you're running a training round and can properly gauge demand, not so great when you're offering an API.
It says the numbers are theoretically possible. Requiring a 66% usage to break even when 100% usage will piss off customers by invoking a queue means it’s a balancing act.
“Technically correct. The best kind of correct”. So inference may technically be _capable_ of being profitable, but I have question’s about them being profitable in _practice_.
And after graduation they can grind leetcode, and after that they can practice social cues to get in the management class. It's gamed tests all the way down.
True, I only listed it because, at least where I live, high schools often do one program or the other. If it's an IB school, you end up taking the APs on your own (ie, there isn't a class focused on that content, though the IB curriculum should, in theory, end up covering the same stuff, at least for the major subjects).
reply