Science can be self-correcting — but only if we invest in making it so. Our view on the staggering costs of undetected errors in science, and why funding error detection and correction is less expensive, published today in @Nature
Borrowing the idea of ‘bug bounties’ from the technology industry could provide a systematic way to detect and correct the errors that litter the scientific literature, says Malte Elson go.nature.com/4dIi1Nv
My paper is out in @PNASNews! I replicate a paper on the impact of COVID vaccine mandates on vaccine uptake. Removing a single bad control variable sign-flips several of the paper’s headline results. The reply’s findings are also not robust. 1/x
pnas.org/doi/10.1073/pnas.24…
Can you imagine if scientists or funders appreciated sleuths like this?
Or if we saw potential examples of misconduct as vulnerabilities in our processes that needed to be addressed?
🚨Replication alert🚨
I reanalyze Moretti (2021), which tests for the effect of tech cluster size on innovation. I find that the event study and instrumental variable estimates—necessary for a causal interpretation—are caused by coding errors.
#EconTwitter
1/
Cash for catching scientific errors 💰
The ERROR project offers researchers a bounty for spotting mistakes in published papers — a strategy borrowed from the software industry. go.nature.com/4fShk50
Challenge accepted. Here are a few comments on the paper after starting to wade through its massive content. The paper in question is nature.com/articles/s41586-0… 1/🧵
New: use GRIM or GRIMMER to test reported statistics for consistency.
Are these values even possible? Find out with the error detection webapp!
Test many values at once, get summary statistics, and download your results. 🧵 1/5
errors.shinyapps.io/scrutiny…
What are the best papers or blog posts you know on difficulties of correcting the scientific record in psychology? Want to write on it and make sure cite the best sources. I recall the term zombie theories in this context.
New Data Colada post. Harvard's Gino Report allows us to re-construct what Harvard says is one of Gino's "original" data sets. We can compare that to the posted data to see how the data were altered datacolada.org/118
⭐️Open Research Summer School ⭐️
Rounding off a whole day on error detection, @ianhussey will be talking about @error_reviews!
Grab your in-person ticket for Monday. Otherwise, there's plenty of spots for remote viewing!
Register here: tinyurl.com/49x793yf
New paper under review!
Danièle Gubler is checking "Environmental sensitivity in children: Development of the Highly Sensitive Child Scale and identification of sensitivity groups" by @michaelpluess et al. for errors.
error.reviews/reviews/pluess…