Alternatively: What's the current status of Personally Identifying Information and language models?
I try to hide my real name whenever possible, out of an abundance of caution. You can still find it if you search carefully, but in today's hostile internet I see this kind of soft pseudonymity as my digital personal space, and expect to have it respected.
When playing around in GPT-3 I tried making sentences with my username. Imagine my surprise when I see it spitting out my (globally unique, unusual) full name!
Looking around, I found a paper that says language models spitting out personal information is a problem[1], a Google blog post that says there's not much that can be done[2], and an article that says OpenAI might automatically replace phone numbers in the future but other types of PII are harder to remove[3]. But nothing on what is actually being done.
If I had found my personal information on Google search results, or Facebook, I could ask the information to be removed, but GPT-3 seems to have no such support. Are we supposed to accept that large language models may reveal private information, with no recourse?
I don't care much about my name being public, but I don't know what else it might have memorized (political affiliations? Sexual preferences? Posts from 13-year old me?). In the age of GDPR this feels like an enormous regression in privacy.
EDIT: a small thank you for everybody commenting so far for not directly linking to specific results or actually writing my name, however easy it might be.
If my request for pseudonymity sounds strange given my lax infosec:
- I'm more worried about the consequences of language models in general than my own case, and
- people have done a lot more for a lot less name information[4].
[1]: https://arxiv.org/abs/2012.07805
[2]: https://ai.googleblog.com/2020/12/privacy-considerations-in-...
[3]: https://www.theregister.com/2021/03/18/openai_gpt3_data/
[4]: https://en.wikipedia.org/wiki/Slate_Star_Codex#New_York_Time...
As a purely practical matter -- again, not going into whether this is how things should be, merely how they do be -- it is futile to want the internet as a whole to have a concept of privacy, or to respect the concept of a "digital personal space". If your phone number or other PII has ever been associated with your identity, that association will be in place indefinitely and is probably available on multiple data broker sites.
The best way to be anonymous on the internet is to be anonymous, which means posting without any name or identifier at all. If that isn't practical, then using a non-meaningful pseudonym and not posting anything personally identifiable is recommended.