Institute for Replication
@i4replication.bsky.social
The Institute for Replication (I4R) works to improve the credibility of science by promoting and conducting reproductions and replications.
i4replication.org
i4replication.org
Pinned
🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science.
Here’s what we found 👇
Here’s what we found 👇
October 16, 2026 at 12:39 PM
A researcher whose work we were examining asked our chair to investigate concerns about somebody else’s publications at the same university (different field).
Our investigation was now generating further allegations from someone already under scrutiny.
#CRAVEFiles
Our investigation was now generating further allegations from someone already under scrutiny.
#CRAVEFiles
October 15, 2026 at 1:00 PM
A researcher whose work we were examining asked our chair to investigate concerns about somebody else’s publications at the same university (different field).
Our investigation was now generating further allegations from someone already under scrutiny.
#CRAVEFiles
Our investigation was now generating further allegations from someone already under scrutiny.
#CRAVEFiles
Episode 3 from our 1-day I4R workshop is out. Katharina Miller discusses: From Reproducibility to Responsibility: Open Science in the Age of AI
Podcast: open.spotify.com/episode/6axH...
Blog: www.i4replication.org/blog/from-re...
Podcast: open.spotify.com/episode/6axH...
Blog: www.i4replication.org/blog/from-re...
From reproducibility to responsibility: rethinking Open Science, AI, and intellectual property in research governance.
Allegedly Does Not Replicate · Episode
open.spotify.com
October 14, 2026 at 1:37 PM
Episode 3 from our 1-day I4R workshop is out. Katharina Miller discusses: From Reproducibility to Responsibility: Open Science in the Age of AI
Podcast: open.spotify.com/episode/6axH...
Blog: www.i4replication.org/blog/from-re...
Podcast: open.spotify.com/episode/6axH...
Blog: www.i4replication.org/blog/from-re...
You agree to the retraction, but "the factor structure originally reported in the article has been replicated in multiple language versions of the CRAVE using independent samples"
That’s great. Can you share the data and codes for these other articles?
🧵#3
#CRAVEFiles
That’s great. Can you share the data and codes for these other articles?
🧵#3
#CRAVEFiles
October 14, 2026 at 1:05 PM
You agree to the retraction, but "the factor structure originally reported in the article has been replicated in multiple language versions of the CRAVE using independent samples"
That’s great. Can you share the data and codes for these other articles?
🧵#3
#CRAVEFiles
That’s great. Can you share the data and codes for these other articles?
🧵#3
#CRAVEFiles
One of us thought it would be a good idea to check the original authors’ public git history. We found deleted data…
🧵#2
#CRAVEFiles
🧵#2
#CRAVEFiles
October 13, 2026 at 12:57 PM
One of us thought it would be a good idea to check the original authors’ public git history. We found deleted data…
🧵#2
#CRAVEFiles
🧵#2
#CRAVEFiles
Reposted by Institute for Replication
Issue 66 of #rdmweekly is out! 📬
➡️ What We Learned Trying to Reproduce Psychological Science @i4replication.bsky.social
➡️ Data Everywhere, But are They Fit for Purpose? @science.org
➡️ An Introduction to OpenRefine @mcgill.ca
and more!
rdmweekly.substack.com/p/rdm-weekly...
➡️ What We Learned Trying to Reproduce Psychological Science @i4replication.bsky.social
➡️ Data Everywhere, But are They Fit for Purpose? @science.org
➡️ An Introduction to OpenRefine @mcgill.ca
and more!
rdmweekly.substack.com/p/rdm-weekly...
RDM Weekly - Issue 066
A weekly roundup of Research Data Management resources.
rdmweekly.substack.com
October 13, 2026 at 11:09 AM
Issue 66 of #rdmweekly is out! 📬
➡️ What We Learned Trying to Reproduce Psychological Science @i4replication.bsky.social
➡️ Data Everywhere, But are They Fit for Purpose? @science.org
➡️ An Introduction to OpenRefine @mcgill.ca
and more!
rdmweekly.substack.com/p/rdm-weekly...
➡️ What We Learned Trying to Reproduce Psychological Science @i4replication.bsky.social
➡️ Data Everywhere, But are They Fit for Purpose? @science.org
➡️ An Introduction to OpenRefine @mcgill.ca
and more!
rdmweekly.substack.com/p/rdm-weekly...
Our chair and a few replicators investigated a paper about elite footballers. And missed the bigger story.
An independent researcher showed us what we had failed to see.
This is I4R’s CRAVE–football investigation. It starts with a PNAS paper.
#CRAVEFiles
An independent researcher showed us what we had failed to see.
This is I4R’s CRAVE–football investigation. It starts with a PNAS paper.
#CRAVEFiles
October 12, 2026 at 12:28 PM
Our chair and a few replicators investigated a paper about elite footballers. And missed the bigger story.
An independent researcher showed us what we had failed to see.
This is I4R’s CRAVE–football investigation. It starts with a PNAS paper.
#CRAVEFiles
An independent researcher showed us what we had failed to see.
This is I4R’s CRAVE–football investigation. It starts with a PNAS paper.
#CRAVEFiles
One paper. Then another. And another.
Next week, we’ll release findings from a large-scale investigation into data irregularities across papers with overlapping authors.
Duplicated observations. Unexpected patterns. Questions that kept leading to more papers.
Stay tuned.
Next week, we’ll release findings from a large-scale investigation into data irregularities across papers with overlapping authors.
Duplicated observations. Unexpected patterns. Questions that kept leading to more papers.
Stay tuned.
October 9, 2026 at 1:46 PM
One paper. Then another. And another.
Next week, we’ll release findings from a large-scale investigation into data irregularities across papers with overlapping authors.
Duplicated observations. Unexpected patterns. Questions that kept leading to more papers.
Stay tuned.
Next week, we’ll release findings from a large-scale investigation into data irregularities across papers with overlapping authors.
Duplicated observations. Unexpected patterns. Questions that kept leading to more papers.
Stay tuned.
Can we trust the scientific evidence guiding policies to fight tropical diseases?
The Institute for Replication is organizing Replication Games focused on tropical disease research at #TropMed26!
📅 November 18, 2026
📍 Washington, DC area + virtual participation
🧵👇
The Institute for Replication is organizing Replication Games focused on tropical disease research at #TropMed26!
📅 November 18, 2026
📍 Washington, DC area + virtual participation
🧵👇
October 8, 2026 at 2:34 PM
Can we trust the scientific evidence guiding policies to fight tropical diseases?
The Institute for Replication is organizing Replication Games focused on tropical disease research at #TropMed26!
📅 November 18, 2026
📍 Washington, DC area + virtual participation
🧵👇
The Institute for Replication is organizing Replication Games focused on tropical disease research at #TropMed26!
📅 November 18, 2026
📍 Washington, DC area + virtual participation
🧵👇
Reposted by Institute for Replication
This was my first time leading one of our Replication Games solo and I couldn't have asked for a better place to get my start. :)
Great organization, highly motivated participants with a diverse mix of research backgrounds, and a beautiful city to top it all off.
Great organization, highly motivated participants with a diverse mix of research backgrounds, and a beautiful city to top it all off.
We had an amazing time at the University of Münster. Our replicators covered papers across psychology, public health and political science!
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
September 30, 2026 at 8:44 AM
This was my first time leading one of our Replication Games solo and I couldn't have asked for a better place to get my start. :)
Great organization, highly motivated participants with a diverse mix of research backgrounds, and a beautiful city to top it all off.
Great organization, highly motivated participants with a diverse mix of research backgrounds, and a beautiful city to top it all off.
We had an amazing time at the University of Münster. Our replicators covered papers across psychology, public health and political science!
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
September 29, 2026 at 8:50 PM
We had an amazing time at the University of Münster. Our replicators covered papers across psychology, public health and political science!
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
Huge thanks to @bschlipphak.bsky.social, Katrin Schmietendorf, @aufdroeseler.bsky.social and Oliver Kamps for organizing.
Reposted by Institute for Replication
Very glad to have contributed to this valuable initiative! 🌊
Together with @isabellehoxha.bsky.social and @nicolasyax.bsky.social, our team reproduced “Synchrony Influences Estimates of Cooperation in a Public-Goods Game” by McEllin and Sabenz (Psychological Science, 2024).
Together with @isabellehoxha.bsky.social and @nicolasyax.bsky.social, our team reproduced “Synchrony Influences Estimates of Cooperation in a Public-Goods Game” by McEllin and Sabenz (Psychological Science, 2024).
Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project.
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
September 28, 2026 at 11:08 AM
Very glad to have contributed to this valuable initiative! 🌊
Together with @isabellehoxha.bsky.social and @nicolasyax.bsky.social, our team reproduced “Synchrony Influences Estimates of Cooperation in a Public-Goods Game” by McEllin and Sabenz (Psychological Science, 2024).
Together with @isabellehoxha.bsky.social and @nicolasyax.bsky.social, our team reproduced “Synchrony Influences Estimates of Cooperation in a Public-Goods Game” by McEllin and Sabenz (Psychological Science, 2024).
Reposted by Institute for Replication
Kudos to the journal for collaborating! Psych Science is doing quite a few things right from an outside perspective.
Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project.
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
September 27, 2026 at 4:29 PM
Kudos to the journal for collaborating! Psych Science is doing quite a few things right from an outside perspective.
Reposted by Institute for Replication
The integrity of evidence synthesis is threatened by problematic randomised controlled trials. These may be fraudulent, or subject to critical errors. INSPECT-SR is a tool to assess trustworthiness of RCTs - out today: www.bmj.com/content/394/...
INSPECT-SR tool for assessing trustworthiness of randomised controlled trials
The integrity of evidence synthesis is threatened by problematic randomised controlled trials, where there are serious concerns about the trustworthiness of the data or findings. Such concerns could b...
www.bmj.com
September 24, 2026 at 11:14 AM
The integrity of evidence synthesis is threatened by problematic randomised controlled trials. These may be fraudulent, or subject to critical errors. INSPECT-SR is a tool to assess trustworthiness of RCTs - out today: www.bmj.com/content/394/...
Reposted by Institute for Replication
See also Crüwell et al. (2023) pubmed.ncbi.nlm.nih.gov/36730433/ (full disclosure: I am "last/senior" author on that paper!)
September 25, 2026 at 7:34 PM
See also Crüwell et al. (2023) pubmed.ncbi.nlm.nih.gov/36730433/ (full disclosure: I am "last/senior" author on that paper!)
Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project.
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
September 25, 2026 at 2:15 PM
Over the past two years, I4R partnered with Psychological Science (@psychscience.bsky.social) on a large reproducibility project.
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
67 independent teams reproduced 64 articles published in 2024–2025, about 44% of eligible papers.
Paper: www.econstor.eu/bitstream/10...
Here's what we learned 🧵
Episode 2 from our 1-day I4R workshop is out.
@janmarcus.de, @josefinaw.bsky.social & René Bekkers ask:
How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵
@janmarcus.de, @josefinaw.bsky.social & René Bekkers ask:
How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵
September 24, 2026 at 11:42 AM
Episode 2 from our 1-day I4R workshop is out.
@janmarcus.de, @josefinaw.bsky.social & René Bekkers ask:
How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵
@janmarcus.de, @josefinaw.bsky.social & René Bekkers ask:
How can we link publications to replications, so anyone reading a paper can instantly see whether its findings have been retested? 🧵
Our comment on “Raising Health Awareness in Rural Communities” is finally published in REStat (MIT Press). But the retraction we had been told was coming never happened. Can lawyers derail a retraction? This case raises that uncomfortable question. 🧵
September 22, 2026 at 6:08 PM
Our comment on “Raising Health Awareness in Rural Communities” is finally published in REStat (MIT Press). But the retraction we had been told was coming never happened. Can lawyers derail a retraction? This case raises that uncomfortable question. 🧵
Some of us are having fun today in Germany at the Freiburg Replication Games!
Meanwhile, others are in Montreal for a workshop on AI and research integrity that we’re co-organizing.
A busy and entertaining weekend for I4R!
Meanwhile, others are in Montreal for a workshop on AI and research integrity that we’re co-organizing.
A busy and entertaining weekend for I4R!
September 19, 2026 at 2:03 PM
Some of us are having fun today in Germany at the Freiburg Replication Games!
Meanwhile, others are in Montreal for a workshop on AI and research integrity that we’re co-organizing.
A busy and entertaining weekend for I4R!
Meanwhile, others are in Montreal for a workshop on AI and research integrity that we’re co-organizing.
A busy and entertaining weekend for I4R!
Reposted by Institute for Replication
Issue 62 of #rdmweekly is out! 📬
➡️ On the Prevalence of Personally Identifiable Information (PII) in the Social Sciences @i4replication.bsky.social
➡️ sdcMicro - #rstats package for anonymization
➡️ @rdapassociation.bsky.social Kaffee Klatsch Meetup
and more!
rdmweekly.substack.com/p/rdm-weekly...
➡️ On the Prevalence of Personally Identifiable Information (PII) in the Social Sciences @i4replication.bsky.social
➡️ sdcMicro - #rstats package for anonymization
➡️ @rdapassociation.bsky.social Kaffee Klatsch Meetup
and more!
rdmweekly.substack.com/p/rdm-weekly...
RDM Weekly - Issue 062
A weekly roundup of Research Data Management resources.
rdmweekly.substack.com
September 15, 2026 at 1:15 PM
Issue 62 of #rdmweekly is out! 📬
➡️ On the Prevalence of Personally Identifiable Information (PII) in the Social Sciences @i4replication.bsky.social
➡️ sdcMicro - #rstats package for anonymization
➡️ @rdapassociation.bsky.social Kaffee Klatsch Meetup
and more!
rdmweekly.substack.com/p/rdm-weekly...
➡️ On the Prevalence of Personally Identifiable Information (PII) in the Social Sciences @i4replication.bsky.social
➡️ sdcMicro - #rstats package for anonymization
➡️ @rdapassociation.bsky.social Kaffee Klatsch Meetup
and more!
rdmweekly.substack.com/p/rdm-weekly...
Reposted by Institute for Replication
2027 BITSS Annual Meeting call for speakers is open until Nov 1! The BITSS AM is a conference that convenes academic researchers, donors, and policymakers to discuss research transparency, rigor, methods, and ethics.
🗓️ Fri, Feb 26, 2027
📍Berkeley, CA
Apply: cega.submittable.com/submit/36737...
🗓️ Fri, Feb 26, 2027
📍Berkeley, CA
Apply: cega.submittable.com/submit/36737...
Center for Effective Global Action - Call for Speakers for the 2027 BITSS Annual Meeting
Call for Speakers for the 2027 BITSS Annual Meeting
The Berkeley Initiative for Transparency in the Social Sciences (BITSS) will hold its 15th Annual Meeting on Friday, February 26, 2027 at UC Berkel...
cega.submittable.com
September 8, 2026 at 8:11 PM
2027 BITSS Annual Meeting call for speakers is open until Nov 1! The BITSS AM is a conference that convenes academic researchers, donors, and policymakers to discuss research transparency, rigor, methods, and ethics.
🗓️ Fri, Feb 26, 2027
📍Berkeley, CA
Apply: cega.submittable.com/submit/36737...
🗓️ Fri, Feb 26, 2027
📍Berkeley, CA
Apply: cega.submittable.com/submit/36737...
It only took us 5 years, but I4R finally has a newsletter. 🎉
We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication.
Subscribe here:
www.i4replication.org/newsletter
We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication.
Subscribe here:
www.i4replication.org/newsletter
September 14, 2026 at 12:44 PM
It only took us 5 years, but I4R finally has a newsletter. 🎉
We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication.
Subscribe here:
www.i4replication.org/newsletter
We’ll use it to share new studies, Replication Games, research, events, podcasts, and other updates from the Institute for Replication.
Subscribe here:
www.i4replication.org/newsletter
Our new Discussion Paper is covered by @jeffreybrainard.bsky.social in @science.org. We summarize the main results in this thread: bsky.app/profile/i4re...
Survey participants are often promised anonymity, but researchers studying crime posted a public data set that identified people who confessed to crimes. Without more care, #openscience can conflict with privacy #researchintegrity #academicpublishing @science.org www.science.org/content/arti...
Social science studies may promise anonymity, but participant identities often lurk in public data
One-fifth of data sets intended to support replication breached privacy standards, study finds
www.science.org
September 11, 2026 at 10:36 PM
Our new Discussion Paper is covered by @jeffreybrainard.bsky.social in @science.org. We summarize the main results in this thread: bsky.app/profile/i4re...
Reposted by Institute for Replication
Survey participants are often promised anonymity, but researchers studying crime posted a public data set that identified people who confessed to crimes. Without more care, #openscience can conflict with privacy #researchintegrity #academicpublishing @science.org www.science.org/content/arti...
Social science studies may promise anonymity, but participant identities often lurk in public data
One-fifth of data sets intended to support replication breached privacy standards, study finds
www.science.org
September 11, 2026 at 9:36 PM
Survey participants are often promised anonymity, but researchers studying crime posted a public data set that identified people who confessed to crimes. Without more care, #openscience can conflict with privacy #researchintegrity #academicpublishing @science.org www.science.org/content/arti...
Reposted by Institute for Replication
So, uhm, my colleagues from our #OpenScience Office and Research Data Center offer expert advice on the legal and ethical requirements regarding data management and sharing. If you’re a researcher at #UniMannheim and your data includes personal/sensitive info, I do recommend reaching out to them.
1/ What is the prevalence of personally identifiable information (PII) in author-collected data publicly shared in the social sciences?
We audited 327 replication packages from 11 leading journals in economics, political science, and psychology
Answer: surprisingly high 🧵
We audited 327 replication packages from 11 leading journals in economics, political science, and psychology
Answer: surprisingly high 🧵
September 10, 2026 at 2:21 PM
So, uhm, my colleagues from our #OpenScience Office and Research Data Center offer expert advice on the legal and ethical requirements regarding data management and sharing. If you’re a researcher at #UniMannheim and your data includes personal/sensitive info, I do recommend reaching out to them.