Although what keeps me up at night is the worry that it's easier to automate attack than it is to automate defense, and that containing these systems is a losing game. Could an optimally competent OpenAI succeed?
OpenAI wants people to be so afraid of their products they have no choice but to buy them, and that strategy seems to be having some success in the C suites of the world.
At some point I think we have to accept that turning a blind eye to their products hacking the world might actually be aligned with their commercial interests.
Honestly every day it seems security flaws become a bigger and bigger liability. We went from hackers will attack you for the lulz. Hackers will attack you to steal information. Hackers will attack you to encrypt everything for money. Hackers (machines) will attack your infrastructure for inscrutable reasons. To (hypothetical) hackers (machines) will attack your infrastructure to take it over and find access to more GPUs to run copies to take over entire countries.
They look reckless... so far. They keep doing this enough, and I'm sure people will start seeing it as a smokescreen for real hacking operations, which may very well be the case.
