On: Summarize texts up to 50K characters

[petilon]

I use ChatGPT to summarize. It works well, and I can ask questions about the text I paste into ChatGPT.

[throwaway-x → petilon]

I think ChatGPT limits you to a certain number of characters, so you often can't summarize a long article or a paper

[_boffin_ → throwaway-x]

People are chunking text, summarizing that, compiling summaries, and then summarizing those.

basically... map reducing.

Currently doing that to summarize ~4k pages of public comments that comprise of ~22 questions.

[EForEndeavour → _boffin_]

Does this limit what kinds of questions you can ask of the map-reduced summary of summaries? For example, "how many comments mentioned [concept or theme] across the entire set of comments?"