I have suspected for a long time that hosted models load shed by diverting some ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		api 31 days ago \| parent \| context \| favorite \| on: Claude Opus 4.1 I have suspected for a long time that hosted models load shed by diverting some requests to lesser models or running more quantized versions under high load.

parineum 31 days ago [–]

I think OpenRouter saves tokens by summarizing queries through another model, IIRC.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact