I've been developing with Deepgram for a while, and this is one of the coolest demos I've seen with it!
I am curious about total cost to run this thing, though. I assume that on top of whatever you're paying Cerebrium for GPU hosting you're also having to pay for Deepgram Enterprise in order to self-host it.
To get the latency reduction of several hundred milliseconds how much more would it be for "average" usage?
So our costs are based on the infra you use to run your application and we charge per millisecond of compute.
Some things to note that we might do differently to other providers:
1. You can specify your EXACT requirements and we charge you only for that. Eg: if you want 2 vCPU, 12GB Memory and 1 A10 GPU we charge you for that which is 35% less if you rented a whole A10
2. We have over 10 variety of GPU chips so you can choose the price/performance trade-off
3. While you can extend this on the Cerebrium platform, it cannot be used commercially. We are speaking to Deepgram to see how we can offer it to customers. Hopefully I can provide more updates on this soon
I am curious about total cost to run this thing, though. I assume that on top of whatever you're paying Cerebrium for GPU hosting you're also having to pay for Deepgram Enterprise in order to self-host it.
To get the latency reduction of several hundred milliseconds how much more would it be for "average" usage?