If there's very little text before the internet, what would scaling up look like...

		spicyusername 25 days ago \| parent \| context \| favorite \| on: History LLMs: Models trained exclusively on pre-19... If there's very little text before the internet, what would scaling up look like?