Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Where your price is from? https://docs.z.ai/guides/overview/pricing Input tokens: $1.4 Output tokens: $4.4 Cached input: $0.26

The ROI on this hardware from my back-of-envelope calculation is (50M per day for output tokens, 500M (assuming 10x ratio, which again is conservative (probably 4x more realistically)) per day for input tokens, and assuming 90% / 10% mixing (10% output, and 90% input), you are doing $22 + $630 per day), that is less than a year to make the money (2 DGX Stations, $200k) back.

EDIT: actually read the article, it is kinda poorly written with no clear separation what's the performance for decode v.s. prefill, making us arguing about this much less meaningful.

 help



Is there an easy way to actually make money that way, by buying compute and offering it online?

No. You can’t compete with large data centres. You will end up paying more in energy and hardware than what you charge for the compute.

I thought the space was limited by compute resources.

I don't know what you mean.

And it's even cheaper on third party providers. For example the cheapest fp8 on openrouter is $0.5586 input, $0.1037 cached input, $1.756 output. And obviously less on fp4.

third party providers can have really bad latency and other issues though, so probably can't trust the lowest prices you find



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: