That is great. How do you even handle the daily divergence that must happen due to micro decisions made by various APIs. For example I wont mention their name but one OpenAI compatiable provider doesn't fully work with OpenAI client and had various holes so you need to account for that. The other hard thing is just the fast pace of AI. What if the underlying concepts change!
Well done!