On: Making o1, o3, and Sonnet 3.7 hallucinate for everyone

[pinoy420]

A good prompt. You don’t just ask it. You tell it how to behave and give it a shot load of context

[andix → pinoy420]

With Claude the context window is quite small. But with adding too much context it often seems to get worse. If the context is not carefully narrowly picked and too unrelated, the LLMs often start to do unrelated things to what you've asked.

At some point it's not really worth anymore creating the perfect prompt, just code it yourself. Also saves the time to carefully review the AI generated code.

[johnisgood → andix]

Claude's context window is not small, is it not larger than ChatGPT's?

[andix → johnisgood]

I just looked it up, it seems to be the rate limit that's actually kicking in for me.

[johnisgood → andix]

Yes, that's it! It is frustrating to me, too. You have to start a new chat with all relevant data, and a detailed summary of the progress/status.

[troupo → pinoy420]

Doesn't prevent it from hallucinating, only reduces hallucinations by a single digit percentage

[copperroof → troupo]

Personally I’ve been finding that the more context I provide the more it hallucinates.

[Rury → copperroof]

There's probably a sweet spot. Same with people. Too much context (especially unnecessary context) can be confusing/distracting, as well as being too vague (as it leaves room for multiple interpretations). But generally, I find the more refined and explicit you are, the better.