I am not a rah-rah AI person, but I logically have a hard time with complaints about training on publicly accessible content. If your eyes can see it for free, it ends up "training" your brain. If creators don't want that, do not make the content public, and only make it only available via paid routes.
AI is not really learning from it. It's gathering and distributing real folks hard work and maybe making a few slight changes in the language used to describe it so it's more akin to stealing or plagiarizing other's work.
What you just described is teaching, essays, and just about any form of summarized content.
You cannot “steal” information. Me attaining that knowledge does not deprive others of it. You could make an argument for copyright infringement, but honestly, who cares? Me asking an AI does not deprive others of say a book sale, because inherently I am unlikely to be interested in a book on that topic if I just want the magic black box to give me a possibly hallucinated answer instead.
Well let's see. I think what it does is scan the internet for information and associates that with queries asking for specific information. At it's best it could provide insight for new ways to create things one might want to create, and at it's worse it might plagiarize real human's hard work and present it with no reference to those works.