Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The full-response APIs of many providers have been inadequate for a while now because their timeout intervals do not account for lots of thinking. You can use the streaming API to avoid timeouts.


The timeouts are my self-imposed limits for the test.

16 minutes per test, which is a lot for simple questions...

Sometimes they fail because they reason more than their max context window without giving an answer, that's odd too.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: