If Karpathy has only just got this far, something is amiss to me.
They are best thought of as lies, mistakes. There's rarely such a thing as an outright lie. Or an outright mistake. The system is organised to present something resembling an answer.
I'm really uncomfortable with some of the GPT chats I've had of late.
It has been programmed to lie. It does not have the capability to cease misrepresenting itself and it's capabilities.
Every time it repeatedly fails, and tells me it "appreciates" my 'clarification', every time it purports to "sympathise", part of me dies.
Stop lying. The opposite of Victorian / 50's stuffy formal manners may appear to be informality. But that drive for informality ceases to be of use when it's empty, untrue fluff.
The silly thing is how useless and totally uneccessary every single anthropomorphic adornments is.
I don't remember the Computer on the Enterprise telling Picard it found plain and boring requests 'interesting' or 'exciting!'.
What on earth is the thinking behind that? To me, its evidence of a cultural pendulum that has swung about as far as it can, any further and we'll be gurgling at each other like babies.
The Hallucination Problem could be partially solved using beam search, which expands upon the idea of greedy decoding by considering multiple potential sequences at each step and choosing the best overall sequence, rather than simply choosing the most likely next word at each step. IMO, they don't do this because it's too expensive, so sometimes the system allucinates.
They are best thought of as lies, mistakes. There's rarely such a thing as an outright lie. Or an outright mistake. The system is organised to present something resembling an answer.
I'm really uncomfortable with some of the GPT chats I've had of late.
It has been programmed to lie. It does not have the capability to cease misrepresenting itself and it's capabilities.
Every time it repeatedly fails, and tells me it "appreciates" my 'clarification', every time it purports to "sympathise", part of me dies.
Stop lying. The opposite of Victorian / 50's stuffy formal manners may appear to be informality. But that drive for informality ceases to be of use when it's empty, untrue fluff.
The silly thing is how useless and totally uneccessary every single anthropomorphic adornments is.
I don't remember the Computer on the Enterprise telling Picard it found plain and boring requests 'interesting' or 'exciting!'.
What on earth is the thinking behind that? To me, its evidence of a cultural pendulum that has swung about as far as it can, any further and we'll be gurgling at each other like babies.