Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 22, 2026 at 11:05 AM
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
Today we launch the first stable release of RegCheck: v1.0.0.
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
July 14, 2026 at 3:12 PM
Today we launch the first stable release of RegCheck: v1.0.0.
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
April 24, 2026 at 10:16 AM
This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app
RegCheck (
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
July 21, 2026 at 4:27 PM
RegCheck (
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)
April 23, 2026 at 3:04 PM
All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)
WE ARE HIRING!
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 9, 2025 at 12:08 PM
WE ARE HIRING!
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
February 6, 2025 at 11:06 AM
Congratulations to the project “RegCheck,” which received🏆2026 SIPS commendation!
RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations.
regcheck.app
RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations.
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
August 17, 2026 at 7:34 PM
Congratulations to the project “RegCheck,” which received🏆2026 SIPS commendation!
RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations.
regcheck.app
RegCheck is a tool that makes it easier and quicker for researchers to compare published papers with their associated study registrations.
regcheck.app
Introducing RegCheck: a tool which uses Large Language Models to automatically compare preregistered protocols with their corresponding published papers and highlights deviations.
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
RegCheck.app
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
July 23, 2024 at 2:42 PM
Introducing RegCheck: a tool which uses Large Language Models to automatically compare preregistered protocols with their corresponding published papers and highlights deviations.
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
Happy to share that (from August 1st) I'll be spending the next 6 months working at the University of Oxford as a visiting researcher!
I'll be working with @ndevito1.bsky.social and @bengoldacre.bsky.social on developing and extending features of RegCheck (regcheck.app).
I'll be working with @ndevito1.bsky.social and @bengoldacre.bsky.social on developing and extending features of RegCheck (regcheck.app).
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
July 28, 2025 at 9:04 AM
Happy to share that (from August 1st) I'll be spending the next 6 months working at the University of Oxford as a visiting researcher!
I'll be working with @ndevito1.bsky.social and @bengoldacre.bsky.social on developing and extending features of RegCheck (regcheck.app).
I'll be working with @ndevito1.bsky.social and @bengoldacre.bsky.social on developing and extending features of RegCheck (regcheck.app).
RegCheck V2 is out:
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
January 22, 2026 at 11:13 AM
RegCheck V2 is out:
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
8/🧵
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
GitHub - JamieCummins/regcheck
Contribute to JamieCummins/regcheck development by creating an account on GitHub.
github.com
January 22, 2026 at 11:05 AM
8/🧵
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
Services like RegCheck are extremely promising for moving norms forward from doing open science practices to doing open science practices well.
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 22, 2026 at 12:50 PM
Services like RegCheck are extremely promising for moving norms forward from doing open science practices to doing open science practices well.
10/🧵
If you’re interested in:
- using RegCheck,
- stress-testing it,
- identifying bugs,
- or formally evaluating its performance,
I’m very happy to talk.
App: regcheck.app
Preprint: arxiv.org/abs/2601.13330
Code: github.com/JamieCummins...
If you’re interested in:
- using RegCheck,
- stress-testing it,
- identifying bugs,
- or formally evaluating its performance,
I’m very happy to talk.
App: regcheck.app
Preprint: arxiv.org/abs/2601.13330
Code: github.com/JamieCummins...
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 22, 2026 at 11:05 AM
10/🧵
If you’re interested in:
- using RegCheck,
- stress-testing it,
- identifying bugs,
- or formally evaluating its performance,
I’m very happy to talk.
App: regcheck.app
Preprint: arxiv.org/abs/2601.13330
Code: github.com/JamieCummins...
If you’re interested in:
- using RegCheck,
- stress-testing it,
- identifying bugs,
- or formally evaluating its performance,
I’m very happy to talk.
App: regcheck.app
Preprint: arxiv.org/abs/2601.13330
Code: github.com/JamieCummins...
Leading polisci journal clarifies that it is allowed to deviate from pre-analysis plans but deviations must be transparently disclosed. Good.
P.S. This LLM-based service for tracking deviations from PAP is awesome: regcheck.app
P.S. This LLM-based service for tracking deviations from PAP is awesome: regcheck.app
May 13, 2026 at 6:47 PM
Leading polisci journal clarifies that it is allowed to deviate from pre-analysis plans but deviations must be transparently disclosed. Good.
P.S. This LLM-based service for tracking deviations from PAP is awesome: regcheck.app
P.S. This LLM-based service for tracking deviations from PAP is awesome: regcheck.app
I’m a big fan of RegCheck by @jamiecummins.bsky.social. I found some deviations in a paper the other day using it
regcheck.app/result/8825b...
I hope journals start integrating it. I also recall our thread about registered reports having better defense against this
regcheck.app/result/8825b...
I hope journals start integrating it. I also recall our thread about registered reports having better defense against this
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
August 28, 2026 at 4:38 PM
I’m a big fan of RegCheck by @jamiecummins.bsky.social. I found some deviations in a paper the other day using it
regcheck.app/result/8825b...
I hope journals start integrating it. I also recall our thread about registered reports having better defense against this
regcheck.app/result/8825b...
I hope journals start integrating it. I also recall our thread about registered reports having better defense against this
Another great post showing the flexibility and usefulness of the new Papercheck tool.
Interestingly, RegCheck handles the issue Daniel flags below correctly (i.e., it does not make claims about the non-preregistered cohort B; only cohort A):
Interestingly, RegCheck handles the issue Daniel flags below correctly (i.e., it does not make claims about the non-preregistered cohort B; only cohort A):
June 23, 2025 at 10:55 AM
Another great post showing the flexibility and usefulness of the new Papercheck tool.
Interestingly, RegCheck handles the issue Daniel flags below correctly (i.e., it does not make claims about the non-preregistered cohort B; only cohort A):
Interestingly, RegCheck handles the issue Daniel flags below correctly (i.e., it does not make claims about the non-preregistered cohort B; only cohort A):
RegCheck is one of our group's most exciting projects IMO, and I'm particularly happy to see the codebase now be open scourced!
8/🧵
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
Finally, I fulfill something long-promised: a full, open-source release of the entire RegCheck codebase.
This comes with instructions on how to run RegCheck locally, both as a local implementation of the GUI, and as a standalone CLI application. Find the code here:
github.com/JamieCummins...
GitHub - JamieCummins/regcheck
Contribute to JamieCummins/regcheck development by creating an account on GitHub.
github.com
January 22, 2026 at 11:57 AM
RegCheck is one of our group's most exciting projects IMO, and I'm particularly happy to see the codebase now be open scourced!
There are still a few days to apply to work with me and @malte.the100.ci as a PhD or postdoc on the development and evaluation of RegCheck. Help us research whether RegCheck works in practice in helping to reduce preregistration-paper discrepancies. Apply below!
WE ARE HIRING!
Come work with us (me + @malte.the100.ci) on developing and validating RegCheck. PhD or postdoc applications welcome. Folk with backgrounds in meta-science, psychology, (pre)clinical trials, and/or economics are especially invited to apply.
jobs.unibe.ch/job-vacancie...
Come work with us (me + @malte.the100.ci) on developing and validating RegCheck. PhD or postdoc applications welcome. Folk with backgrounds in meta-science, psychology, (pre)clinical trials, and/or economics are especially invited to apply.
jobs.unibe.ch/job-vacancie...
PhD Student/ Postdoc Position in Meta-Science - Universität Bern
Universität Bern is looking for PhD Student/ Postdoc Position in Meta-Science
jobs.unibe.ch
July 20, 2026 at 2:20 PM
There are still a few days to apply to work with me and @malte.the100.ci as a PhD or postdoc on the development and evaluation of RegCheck. Help us research whether RegCheck works in practice in helping to reduce preregistration-paper discrepancies. Apply below!
It was an honour to have RegCheck featured in this most recent issue of REACH magazine. Check it out below!
The January-March 2026 issue of REACH is now live! 🎉
📘Inside: CRediT, the Einstein Foundation Award, Cochrane's 30th anniversary, Jennifer Byrne on paper mills, our SIA Special Report on AI Stress Points in Scholarly Publishing (Part I), and much more!
👉🏻 www.sci-integrity.com/reach-januar...
📘Inside: CRediT, the Einstein Foundation Award, Cochrane's 30th anniversary, Jennifer Byrne on paper mills, our SIA Special Report on AI Stress Points in Scholarly Publishing (Part I), and much more!
👉🏻 www.sci-integrity.com/reach-januar...
REACH January-March 2026 | Science Integrity Alliance
REACH is a modern, interactive, and comprehensive digital magazine designed to meet the shared needs of all stakeholders in the research community.
www.sci-integrity.com
March 17, 2026 at 8:04 AM
It was an honour to have RegCheck featured in this most recent issue of REACH magazine. Check it out below!
RegCheck V2 is out!
Try it out yourself: regcheck.app
Read more about it: arxiv.org/abs/2601.13330
Check out the codebase: github.com/JamieCummins...
Try it out yourself: regcheck.app
Read more about it: arxiv.org/abs/2601.13330
Check out the codebase: github.com/JamieCummins...
January 22, 2026 at 11:51 AM
RegCheck V2 is out!
Try it out yourself: regcheck.app
Read more about it: arxiv.org/abs/2601.13330
Check out the codebase: github.com/JamieCummins...
Try it out yourself: regcheck.app
Read more about it: arxiv.org/abs/2601.13330
Check out the codebase: github.com/JamieCummins...
Yes you’re right! Thanks for the shout out. RegCheck (regcheck.app) currently compares manuscripts with preregistrations, and we’re in the process of building out a module that compares code with in-paper analysis descriptions!
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
May 10, 2025 at 9:47 AM
Yes you’re right! Thanks for the shout out. RegCheck (regcheck.app) currently compares manuscripts with preregistrations, and we’re in the process of building out a module that compares code with in-paper analysis descriptions!
9/🧵
This release was long overdue, and it represents the next stage of a more mature part of the RegCheck lifecycle, in terms of both tech and research.
In 2026, you can expect publication of projects using RegCheck across psychology, clinical medicine, and economics.
This release was long overdue, and it represents the next stage of a more mature part of the RegCheck lifecycle, in terms of both tech and research.
In 2026, you can expect publication of projects using RegCheck across psychology, clinical medicine, and economics.
January 22, 2026 at 11:05 AM
9/🧵
This release was long overdue, and it represents the next stage of a more mature part of the RegCheck lifecycle, in terms of both tech and research.
In 2026, you can expect publication of projects using RegCheck across psychology, clinical medicine, and economics.
This release was long overdue, and it represents the next stage of a more mature part of the RegCheck lifecycle, in terms of both tech and research.
In 2026, you can expect publication of projects using RegCheck across psychology, clinical medicine, and economics.
6/🧵
I have also added integration with the ClinicalTrials.gov API.
You can now provide a ClinicalTrials.gov identifier and RegCheck will automatically retrieve the registration.
I have also added integration with the ClinicalTrials.gov API.
You can now provide a ClinicalTrials.gov identifier and RegCheck will automatically retrieve the registration.
January 22, 2026 at 11:05 AM
6/🧵
I have also added integration with the ClinicalTrials.gov API.
You can now provide a ClinicalTrials.gov identifier and RegCheck will automatically retrieve the registration.
I have also added integration with the ClinicalTrials.gov API.
You can now provide a ClinicalTrials.gov identifier and RegCheck will automatically retrieve the registration.
RegCheck leverages LLMs and AI to automatically compare preregistration plans with scientific publications. This lets researchers effortlessly identify if and how executed studies deviated from the initial plan regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
September 16, 2026 at 4:29 PM
RegCheck leverages LLMs and AI to automatically compare preregistration plans with scientific publications. This lets researchers effortlessly identify if and how executed studies deviated from the initial plan regcheck.app