My theory is there is actual knowledge in the user logs.
When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.
Future AI's can say with more confidence that hitting it with a hammer will probably work.
Across billions of conversations, that can add up to more knowledge than all books.
When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.
Future AI's can say with more confidence that hitting it with a hammer will probably work.
Across billions of conversations, that can add up to more knowledge than all books.