On: AI agent bankrupted their operator while trying to scan DN42

[helsinkiandrew]

I'm not sure why people assume the coming AGI super agents will be infallible.

There's no sign that highly intelligent people can't be conned - Bernie Maddoff fooled leading scientists and CEOs working in finance. Software engineers and lawyers fall for pig butchering schemes and spoofed emails with altered bank details every week - so why would an AGI trained from human content be any different.

[lionkor → helsinkiandrew]

$1T valuation AI better be infallible.

[mey → lionkor]

Narrator: The AI was not infact infallible.