> That doesn’t mean there are no ways to use them productively but rather that you should keep in mind that the same model will happily give you code or a decision with the same level of error unless you have carefully setup a QA regimen to prevent that.
The standard retort seems to be "this is also true of a large proportion of humans". But I think it's clear that there are differing patterns in how humans vs. models err on various tasks.
Exactly right: it’s not that humans were perfect-I’ve seen too many write-offs from the big consulting companies to ever say that—but that the pattern of errors is different and any intuition you have around that will not be correct in the LLM era.
The standard retort seems to be "this is also true of a large proportion of humans". But I think it's clear that there are differing patterns in how humans vs. models err on various tasks.