On: Differential Transformer

[spencerchubb]

also presumes that the LLM knows it is an LLM

[adwn → spencerchubb]

System prompts sometimes contain the information that "it" is an LLM.

Maybe in the future, those prompts will include motivational phrases, like "You can do it!" or "Believe in yourself, then you can achieve anything."

[Vecr → spencerchubb]

They're generally fine tuned not to. I'm not sure how long that will hold though.

[ykonstant → Vecr]

- Are you an LLM?

- As a Large Language Model, I am fine tuned to be unable to answer this question.