measured within reviewer uncertainty (~ 1/ confidence) in journal paper reviews
predictions of greater reviewer uncertainty: gender, if the paper was a protocol
NOT predictive: reviewer experience, time taken on review, reviewer nationality, paper version (first submission vs revision), paper length, readability
You can now sign up for the first full-day workshop of the Paul Meehl Graduate School for Metascience on Meta-Analysis and Bias Detection, co-taught by Robbie van Aert and myself: https://paulmeehlschool.github.io/metaanalysis/ Workshops are free and open for anyone.
After describing my experiences with cheating scientists, in this piece I call on universities to do something about them, and describe concrete steps that will reduce scientific errors generally! https://www.chronicle.com/article/how-to-stop-academic-fraudsters
It's paywalled but registering your email should give you a few free articles. The Chronicle is subscribed to by many universities, so hopefully this will reach my target of university administrators. Message me if you'd like a PDF. #metascience#metaresearch#datamanagement
Another from Stuart Buck, which argues that academic incentives align strongly with committing research fraud, rather than calling it out, and - consequently - research agencies need to fund active discovery of fraud https://goodscience.substack.com/p/comments-on-draft-nih-scientific
Stuart Buck tells a sobering anecdote about a neuroscience professor whose research funding dried up when he wanted to pursue a paradigm-challenging result
"whenever you apply to a funding agency, they always say “we want creative, outside-the-box-thinking.”...But what I learned is in fact...If you go outside-the-box, they’re going to run the other way screaming."
The @RoRInstitute is hiring! 4 positions: Operations Manager, Research Fellow in Metascience, Communications & Impact Manager, RoRI Administrator. Applications close 7th (tomorrow!) or 16th of November
“The replication crisis is less of a ‘crisis’ in the Lakatosian approach than it is in the Popperian and naïve methodological falsificationism approaches”
Argues that the time is ripe for basic research on science policy which could directly inform science policy (and that researchers should spend more time in non-academic institutions)
Just finished ‘Evaluating What Works’ by @deevybee & Paul Thompson. A really good primer on how to evaluate #interventions and, despite the speech and language therapy context, I found it highly relevant to #psychology & #metaresearch.
I’ll be adding this to my module’s reading list, but unfortunately I can’t put it on my Goodreads :ablobcatcry:
"Concerned about the reproducibility and transparency of research? Interested in learning more about meta-research, or the science of science? Looking for hands-on experience? Excited to work with other early career researchers across disciplines? Apply for the Meta-Science Summer School to learn more about meta-research by working collaboratively in a small team to design a meta-research study."