You say this jokingly but it's completely true. I made a kerbal space program clone with local models and the autopilot code was more or less identical to what would work on a real machine. And it took an afternoon. Cat's out of the bag, there's absolutely no way to limit what can be done with LLMs.
