I find a lot of results when searching "gun maker sued for hair trigger", just as I can find results for various AI companies getting sued for helping users commit harm to themselves or others.
Given there's nigh on a billion ChatGPT users, my question would be: what's the fail-dangerous rate for these models? With that many users, we'd could not possibly fail to notice if it was as bad as 0.001% of the advice given each day being dangerous when followed; but we may well not notice if one-in-a-million users end up helping someone plan a mass shooting, or breed the bacteria that makes botulism toxin in what was supposed to be "help me make garlic infused olive oil without cooking", etc.
We have approximations on the risk levels, but unfortunately the models demonstrably respond differently during tests vs. in the wild and we don't know how important that difference is. When a human does that on purpose… I am told "malicious" doesn't legally apply to the Volkswagen emissions scandal, but in common language it sure seems right.
I find a lot of results when searching "gun maker sued for hair trigger", just as I can find results for various AI companies getting sued for helping users commit harm to themselves or others.
Given there's nigh on a billion ChatGPT users, my question would be: what's the fail-dangerous rate for these models? With that many users, we'd could not possibly fail to notice if it was as bad as 0.001% of the advice given each day being dangerous when followed; but we may well not notice if one-in-a-million users end up helping someone plan a mass shooting, or breed the bacteria that makes botulism toxin in what was supposed to be "help me make garlic infused olive oil without cooking", etc.
We have approximations on the risk levels, but unfortunately the models demonstrably respond differently during tests vs. in the wild and we don't know how important that difference is. When a human does that on purpose… I am told "malicious" doesn't legally apply to the Volkswagen emissions scandal, but in common language it sure seems right.