On: Prompt caching for cheaper LLM tokens

[jgeralnik]

Anthropic requires explicit cache markers but will “look backwards” some amount, so you don’t need to fall on the exact split to get cached tokens