On: Stealing Reasoning Traces from Proprietary LLM APIs

[infecto]

Said differently I am surprised it is so easily exploited. While there is a nonzero chance to jailbreak, I would think they would have implemented some rigorous methods to try and prevent leakage.