On: A €0.01 bank transfer could compromise a banking AI agent

[crote]

No, you're still just one clever prompt away from getting pwned. It's like trying to solve SQL injection by attempting to use an ever-increasing pile of regexes for "input validation", rather than just getting rid of string concatenation and using prepared statements instead.

[Timwi → crote]

What SQL system have you been using where just escaping a string requires “an ever-increasing pile of regexes”?

[cowlby → crote]

Im curious to see what that would look like. It’s like inception, how many levels deep can you create a prompt that hijacks all the way up.

[fn-mote → cowlby]

Modern OS exploit chains should give you a good sense of how far people can go. (Eg, phone OSes are relatively hardened.)

We’re not even at the “ASLR” level of protection for LLMs yet.