In the research literature this is generally called coconut after the first paper published on the idea. It has advantages and disadvantages. I agree it’s more efficient. But the lack of observability and transferability are real downsides that block its adoption.
Exactly. This is how the Huggingface incident was reconstructed. But GPT-6 uses partially Neuralese, and its monitorability has dropped sharply according to benchmarks.