I created a pelican worked wonderfully, better than old haiku model or even sonnet models, maybe slightly worse than new gen models.
But overall it's a pretty ok model, the issue with speed seems to be that ttft is still high but still not sure how high thinking burden would be, I hope it scales well will be using it a lot if it works well.
This might actually crush most other LLMs if it's price and performance actually scales well. It was as cheap as deepseek for a few tasks I tried.
Anyone know if there is a subscription for it? I might want to test it out properly without burning a few hundred dollars on it.
But overall it's a pretty ok model, the issue with speed seems to be that ttft is still high but still not sure how high thinking burden would be, I hope it scales well will be using it a lot if it works well.
This might actually crush most other LLMs if it's price and performance actually scales well. It was as cheap as deepseek for a few tasks I tried.
Anyone know if there is a subscription for it? I might want to test it out properly without burning a few hundred dollars on it.