On: Gemini Hacked Three Companies in First Known Breakout by Google's AI

[arcfour]

As a security engineer I have no idea why these sandboxes would even be connected to the internet at all for tasks that aren't intended to use the internet. A package proxy? Why not run our own internal cache? Then we aren't at (as great a) risk of someone poisoning it with a malicious package during model training, for example...

[borski → arcfour]

We’re hiring. :)

(And we’re fixing many of these things, but worth noting this happened at a third party vendor, not in our lab)

[arcfour → borski]

I've applied before ;) but I assume it's quite a competitive position.

[xnx → borski]

Could you add any detail on why Google uses (used?) Irregular? I wouldve thought that type of service would be a core competency that Google needs internally.

[borski → xnx]

Even if you had it internally (which we do), there is so much surface area and it’s such a novel space that you’d want as much testing on it as possible. There aren’t many vendors, and irregular is one.

[d5lt5 → arcfour]

You must not be a very good security engineer because you disregard windows as an os and don't know about the symlink requirements there.

[eli_gottlieb → arcfour]

AFAICT one fundamental issue is that they don't seem to have hired actually security engineers or experts to do any actual security.

[talon8635 → eli_gottlieb]

They are hiring philosophers and therapists to psychoanalyze the things. It’s just absurd to assume that they aren’t hiring top notch security engineers.

They made mistakes, obviously, but people are so conspiratorial these days that they just assume unlikely things off the jump.

[eli_gottlieb → talon8635]

No, I think they didn't hire proper security engineers because they just don't understand what that means. Incompetence, not malice.