On: If you don't run your own LLM proxy, how do you know whats going on?

[hetspookjee]

Mlflow does it pretty nice including session gathering and optional data enrichment (eg what files were touched, what model was used, git remote). We use these session IDs for commenting on issues and stories touched by AI for context tracing.

I just wrapped around the Mlflow setup to make this simple CLI helper to set it up. Ofcourse the name suggests only Claude but it’s Codex, CC, GHCP and Agy. https://pypi.org/project/claudetracing/

https://github.com/CauchyIO/claudetracing