Moreover, they still have that data juding from OPs screenshot with the diff view, lol. I don't think it would be very hard for AI to figure out that it's a garbage answer and just pull the version before edits.
This problem is not a technical one; the companies already have the data.
No, but the social problem is that StackOverflow's entire reason to exist is to provide correct answers common questions. So of course they will intervene if somebody starts ripping answers off the human facing user interface as well. The net will interpret damage as damage and route around it.
How is an AI supposed to work that out? Given the talk about how these models have a tendency to confabulate, this would seem problematic. Idk though, maybe this is now a thing?
The diff is there, so the original answer exists and it seems like they prepared for this so they can easily refrain it with the original answer, or this is all idle speculation and they took it into account already. Being at a company that uses ai, data scientists know the problems and probably have discussed it at some length and covered these cases
Not prompt engineer, but can't you ask it to answer yes or no to "Are these two comments vaguely about the same thing"? I'm not sure where the confabulation can happen, aside from misclassification which can be solved by getting a human and/or more LLMs to review the decision.
Interesting, did not know these things could be used to make assessments, judgments, categorizations, etc. Had been under the impression they just riff out text based on suggestions.
This problem is not a technical one; the companies already have the data.