On: Salesforce study finds LLM agents flunk CRM and confidentiality tests

[sausagefeet]

Is that sufficient? I'm not very adept at modern AI but it feels to me like the only reliable solution is to not have the data in the model at all. Is that what you're saying accomplishes?

[rafaelmn → sausagefeet]

Yes. It's basically treat the model as another frontend approach - that way the model has the same scopes as any frontend app would.

[spwa4 → rafaelmn]

Why wouldn't the human mind have the same problem? Hell, it's ironic because one thing ML is pretty damn good at is to get humans to violate their prompting, and, frankly, basic rational thought:

https://www.ic3.gov/PSA/2024/PSA241203

Or, more concretely:

https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-ho...