Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This seems to be exactly what ChatGPT is good at: present static knowledge from a given text corpus in a linguistically fluent manner.

The full ChatGPT does that for "the internet" as it was on training time (2021). One of its disadvantages/challenges for information retrieval tasks is that its knowledge cannot be updated easily (perhaps soon to be more or less resolved), and that it's unclear how it has gathered the specific knowledge it is presenting.

Regarding the updating part, it still needs an automated way to discover new sources which leads back to internet crawling and hence one of the most costly parts of current search engines.



From how I understand it, ChatGPT doesn't have any knowledge. It's just a language model.


> present static knowledge

It's not that ChatGPT is knowledgable, it's that it's presenting knowledge.

It's mathematically choosing an order of words to present knowledge we've encoded it with/trained it on.

The choice of the words itself isn't really knowledge (depending on how you define knowledge).

There is a related thought experiment that addresses this idea https://en.wikipedia.org/wiki/Chinese_room


A language model by definition encodes knowledge about a language...

If you mean "it doesn't also have knowledge of the wolrd, facts etc", well, it has been trained with a huge corpus of all kinds of material, so it does.

If you mean "it doesn't understand it, so it's not real knowledge", then that's getting into philosophy/semantics, and it could be argue that it does, or that what humans do is not very different...


> From how I understand it, ChatGPT doesn't have any knowledge.

How do you define "having any knowledge"? How is what ChatGPT does different from that definition?


it summarizes the plots of movies or reinterprets them if you prompt it to. that should count as knowledge i think




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: