Yeah, this is a real problem. The incentive structure is such that people are encouraged to find "novel" things. This leads to lots of data-dredging for significant findings that are counter-intuitive.
And because of the bias towards novelty, replications are not regarded as worth publishing and so these results remain unchallenged.
It's a hard problem, and has been known to be a hard problem for at least the last forty years (within psychology, at least) and yet very little has been done.
Brian Nosek and the OSF are doing good work here though.
And because of the bias towards novelty, replications are not regarded as worth publishing and so these results remain unchallenged.
It's a hard problem, and has been known to be a hard problem for at least the last forty years (within psychology, at least) and yet very little has been done.
Brian Nosek and the OSF are doing good work here though.