It's a practical thing. If you write a secret down, then there's another instance of it in the world; an instance that might (and most likely will) be mishandled or otherwise discovered by third party, accidentally or not. So if there's any instance of the secret outside of your head, it's better to treat it as 'public but not yet discovered by people', and adjust your OPSEC accordingly.
