This is more like an experiment more than practical use with the stated 6 toks/s. Paying 6gs for that and days of setup when the next model may come in a month
Welcome to the agentic age, where prompting can be just barely automated, but tokens are so cheap it doesn’t matter. Fresh off the presses as of last week
What people are betting on by selling is there would be a short term pause or deceleration in the investment while they try to squeeze more from their current batch, could be some efficiency catchup
reply