AI Hallucinations Are Fueling a New Class of Supply Chain Attacks

[sksxihve]

https://socket.dev/blog/slopsquatting-how-ai-hallucinations-are-fueling-a-new-class-of-supply-chain-attacks

[pera]

I was talking about this issue with a friend a while ago: If an LLM often hallucinates the same package name for a common problem you could copy an existing library, adapt the API to fit the hallucination, use the same hallucinated name and finally include a backdoor.

[jruohonen]

"They found that 8.7% of hallucinated Python packages were actually valid npm (JavaScript) packages"

[warkdarrior → jruohonen]

So those package names are not really hallucinated, since the packages actuualy exist?

[citizenkeen → warkdarrior]

I’m not sure if you know this, but Python and JavaScript are different languages. Their libraries are different ecosystems, so that’s definitely a hallucination.

[foogazi → citizenkeen]

Yes, but the names are not hallucinated

They being python is the hallucination- the names exist in its training data

[faut_reflechir → warkdarrior]

it's two different languages