On: Show HN: TabGPT - Ask Gemini, ChatGPT, Claude at the Same Time in Chrome

[hoerzu]

The point is the VC money funding something unsustainable (burning through billions). Token prices will never be zero IMO.

[meiraleal → hoerzu]

Yes they will. They are already, if you run local models, that are only getting better. There are 7-11B models that are as good as ChatGPT 3.5

[chatmasta → meiraleal]

Token costs are not zero when you’re running local models, because you paid for the hardware, and you can’t scale inference indefinitely without paying for more hardware.

[hoerzu → meiraleal]

Ok, but running a 11B model gets things 60% of the time right and consumes maximum of electricity of your machine. Not sure if that makes you product the best. Further video generation is very compute intensive. I guess price will decrease over time but the technical advance will allways be for the smarter model

[meiraleal → hoerzu]

> and consumes maximum of electricity of your machine

OpenAI isn't a eletricity company so the token prize is still zero for what is worth for VCs.

> but the technical advance will allways be for the smarter model

Not true. Currently, the small models are advancing much faster with daily new releases