There is a reason why Anthropic and OpenAI are choosing to run their inference on Trainium, it's highly gated right now, but we're trying to add support in the open and for open models!
There is a reason why Anthropic and OpenAI are choosing to run their inference on Trainium, it's highly gated right now, but we're trying to add support in the open and for open models!