Hacker News new | past | comments | ask | show | jobs | submit login
The way ChatGPT handles large text files is great – how?
1 point by is-is-odd 36 days ago | hide | past | favorite | 1 comment
if you upload a large pdf/txt of a book, it's able to be aware of specific content on any page far beyond the context window limit as per the API. so they must be handling the files differently than loading the contents into the prompt. what techniques are there to handle a large amount of info like all the text from a book? this isn't available through the API



Retrieval Augmented Generation, probably.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: