> It regularly seems to come up with terms and descriptions for things in its chain of reasoning and then uses these terms in its output assuming you understand what it's talking about.
GPT does this all the time, too (both Sol and Astra). I constantly have to tell it to not use terms that were not part of the initial prompt.
I don't know how people are managing hands-off with Sol/Astra over long horizon tasks. It will come up with 100 new concepts/terms and then use them as if you've been following every Edit call for 24 hours.
Itβs probably an assumption baked into the training pipeline from that ancient time six months ago when we mostly were manually following each edit tool call.
> I constantly have to tell it to not use terms that were not part of the initial prompt.
Hah, yeah even when you put it in AGENTS.md or a skill.. constantly having to remind it.. "what does AGENTS.md" say about doing that?".. Thinking.. Thinking.. "Oh, it says I should never do that, I'll remember that next time.."
GPT does this all the time, too (both Sol and Astra). I constantly have to tell it to not use terms that were not part of the initial prompt.