Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Why is there a slur list in copilot?



Remember when Microsoft launched a chat bot?

https://arstechnica.com/information-technology/2016/03/tay-t...


This occasionally gets brought up as an example in the context of problems with AI, but is it at all relevant?

Per Gwern[0]:

> (...) There appear to be several similar AI-related leprechauns: the infamous Tay bot, which was supposedly educated by 4chan into being evil, appears to have been mostly a simple ‘echo’ function (common in chatbots or IRC bots) and the non-“repeat after me” Tay texts are generally short, generic, and cherrypicked out of tens or hundreds of thousands of responses, and it’s highly unclear if Tay ‘learned’ anything at all in the short time that it was operational;

[0] https://www.gwern.net/Leprechauns, self-recommending


Thanks for linking to an interesting site


Because without it, they'll end up with inevitable outraged news posts "New AI coding tool Copilot generates offensive text" killing the project for no good reason.


Here are some possible headlines: "Copilot doesn't see genders, and that is a bad thing"

"Copilot accused of antisemitism after it treats Israel as invisible"

"Indy Mech game developers for 'Tank man' confused why Copilot refuses to help"


Those headlines, if they were ever to be written, are a hell of a lot more tame than the ones Microsoft has generated in the past.

https://arstechnica.com/information-technology/2016/03/micro...


The flip side is they are taking on additional maintenance there.


Always better than boring outrage press.


Because there is a certain vocal demographic of people who think words can physically hurt people, so Microsoft needs to go to extreme lengths to avoid that demographic of people from thinking that people are getting physically hurt by using those words.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: