WE ARE HIRING!
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 9, 2025 at 12:08 PM
WE ARE HIRING!
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
Are you interested in LLMs, metascience, and their intersection?
We’re hiring a full time postdoc on a three-year contract to help us develop, evaluate, and extend RegCheck (regcheck.app), our app for automatically comparing research papers with their preregistrations.
🚨 New blog post: "Retrieving Planned Sample Sizes from AsPredicted Preregistrations"
🔗 daniellakens.blogspot.com/2025/06/retr...
We show how Papercheck can automatically extract planned sample sizes — which are the most common deviation in preregistrations. 1/3
🔗 daniellakens.blogspot.com/2025/06/retr...
We show how Papercheck can automatically extract planned sample sizes — which are the most common deviation in preregistrations. 1/3
Retrieving Planned Sample Sizes from AsPredicted Preregistrations
It is increasingly common for researchers to preregister their studies ( Spi...
daniellakens.blogspot.com
June 23, 2025 at 9:39 AM
🚨 New blog post: "Retrieving Planned Sample Sizes from AsPredicted Preregistrations"
🔗 daniellakens.blogspot.com/2025/06/retr...
We show how Papercheck can automatically extract planned sample sizes — which are the most common deviation in preregistrations. 1/3
🔗 daniellakens.blogspot.com/2025/06/retr...
We show how Papercheck can automatically extract planned sample sizes — which are the most common deviation in preregistrations. 1/3
February 6, 2025 at 11:06 AM
How complete are preregistrations?
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
A Cross-Sectional Study of the Completeness of Preregistrations by Psychological Authors From German-Speaking Institutions - Lena Hahn, Andreas Glöckner, Mario Gollwitzer, Jens Hellmann, Jens Lange, S...
Preregistering confirmatory research aims at reducing researchers’ degrees of freedom and increasing transparency to ultimately increase replicability. Yet the ...
doi.org
August 18, 2025 at 11:06 AM
How complete are preregistrations?
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
Short answer: 53% include all 6 procedural specifications
Medium answer: 🧵
Long answer: check out my publication with A. Glöckner @mariogollwitzer.bsky.social J. Hellmann, J. Lange, S. Schindler & @kaisassenberg.bsky.social
doi.org/10.1177/2515...
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 22, 2026 at 11:05 AM
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck (
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
July 21, 2026 at 4:27 PM
RegCheck (
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
regcheck.app) has received a Commendation from the Society for Improving Psychological Science! You can check the other awardees below too:
If you needed a sign from the stars, this is it!
We only have 500 more online preregistrations for #Furnal2026 available!
→ furnalequinox.com/register/
📷 : @catameep.bsky.social
We only have 500 more online preregistrations for #Furnal2026 available!
→ furnalequinox.com/register/
📷 : @catameep.bsky.social
December 11, 2025 at 5:00 PM
If you needed a sign from the stars, this is it!
We only have 500 more online preregistrations for #Furnal2026 available!
→ furnalequinox.com/register/
📷 : @catameep.bsky.social
We only have 500 more online preregistrations for #Furnal2026 available!
→ furnalequinox.com/register/
📷 : @catameep.bsky.social
Today we launch the first stable release of RegCheck: v1.0.0.
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
July 14, 2026 at 3:12 PM
Today we launch the first stable release of RegCheck: v1.0.0.
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
RegCheck makes it easier and quicker to compare study registrations to published papers for consistency - something we know is important in principle, but rarely done in practice.
A 🧵 on what's new:
regcheck.app
Introducing RegCheck: a tool which uses Large Language Models to automatically compare preregistered protocols with their corresponding published papers and highlights deviations.
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
RegCheck.app
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
July 23, 2024 at 2:42 PM
Introducing RegCheck: a tool which uses Large Language Models to automatically compare preregistered protocols with their corresponding published papers and highlights deviations.
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
@malte.the100.ci @ianhussey.bsky.social @ruben.the100.ci @bjoernhommel.bsky.social
regcheck.app
Very cool: Lisa Spitzer has made a deviation from preregistrations template, which you can find here: apps.leibniz-psychology.org/prp-dev/
PreReg: Deviation Template
PreReg: Deviation Template
apps.leibniz-psychology.org
October 17, 2025 at 12:52 PM
Very cool: Lisa Spitzer has made a deviation from preregistrations template, which you can find here: apps.leibniz-psychology.org/prp-dev/
Journal editors - the status quo on preregistration is not working! You need to check submissions vs. preregistrations before sending articles out for review. *56%* of experiments I reviewed in last year have severe problems with non-disclosure, undocumented deviations, & more - see Claude summary ↓
April 23, 2026 at 12:51 PM
Journal editors - the status quo on preregistration is not working! You need to check submissions vs. preregistrations before sending articles out for review. *56%* of experiments I reviewed in last year have severe problems with non-disclosure, undocumented deviations, & more - see Claude summary ↓
All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)
April 23, 2026 at 3:04 PM
All the more reason to use systematic software designed to tackle this very problem, like RegCheck (regcheck.app)
Preregistrations for the Halloween draft and All Leylines' Eve are available on our website now: www.gamershaunt.com/special-events
September 28, 2026 at 4:00 PM
Preregistrations for the Halloween draft and All Leylines' Eve are available on our website now: www.gamershaunt.com/special-events
This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
April 24, 2026 at 10:16 AM
This is why we (@jamiecummins.bsky.social @bethclarke.bsky.social and I) have developed RegCheck, a tool that automatically checks for potential deviations. regcheck.app
➤ Pre-registration Milestone Rewards
▸ 15 million preregistrations: Beetle Coin ×30,000
▸ 20 million preregistrations: Elite Hunter Guide ×20
▸ 25 million preregistrations: Fabricated Dice ×5
▸ 30 million preregistrations: Character "Haniel" ×1
▸ 35 million preregistrations: Fabricated Dice ×15
▸ 15 million preregistrations: Beetle Coin ×30,000
▸ 20 million preregistrations: Elite Hunter Guide ×20
▸ 25 million preregistrations: Fabricated Dice ×5
▸ 30 million preregistrations: Character "Haniel" ×1
▸ 35 million preregistrations: Fabricated Dice ×15
March 4, 2026 at 11:00 AM
➤ Pre-registration Milestone Rewards
▸ 15 million preregistrations: Beetle Coin ×30,000
▸ 20 million preregistrations: Elite Hunter Guide ×20
▸ 25 million preregistrations: Fabricated Dice ×5
▸ 30 million preregistrations: Character "Haniel" ×1
▸ 35 million preregistrations: Fabricated Dice ×15
▸ 15 million preregistrations: Beetle Coin ×30,000
▸ 20 million preregistrations: Elite Hunter Guide ×20
▸ 25 million preregistrations: Fabricated Dice ×5
▸ 30 million preregistrations: Character "Haniel" ×1
▸ 35 million preregistrations: Fabricated Dice ×15
write your preregistrations now!
Question: When will the ANES 2024 data be released?
Answer: We are still finalizing timelines for data releases but anticipate preliminary releases of the pre- and post-election data sometime in the first quarter of 2025.
Answer: We are still finalizing timelines for data releases but anticipate preliminary releases of the pre- and post-election data sometime in the first quarter of 2025.
November 21, 2024 at 6:30 PM
write your preregistrations now!
Although some researchers manage to perfectly adhere to preregistrations, it is common to need to deviate. Not all deviations are consequential, but some are, and it is important to evaluate the impact of deviations on the severity of a test. online.ucpress.edu/collabra/art...
February 6, 2025 at 6:43 PM
Although some researchers manage to perfectly adhere to preregistrations, it is common to need to deviate. Not all deviations are consequential, but some are, and it is important to evaluate the impact of deviations on the severity of a test. online.ucpress.edu/collabra/art...
few people know this: in the well-known photo of developmentalist Jean Piaget he is surrounded by his preregistrations
September 27, 2024 at 9:43 PM
few people know this: in the well-known photo of developmentalist Jean Piaget he is surrounded by his preregistrations
RegCheck V2 is out:
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
January 22, 2026 at 11:13 AM
RegCheck V2 is out:
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
App: regcheck.app
Paper: arxiv.org/abs/2601.13330
Codebase: github.com/JamieCummins...
Currently a lot of attention is going to get people to preregister, to check preregistrations, and noting deviations. But the most important step will be evaluating the impact of the deviations! There is almost no work on this. Good topic for a young metascientist!
February 17, 2026 at 7:12 AM
Currently a lot of attention is going to get people to preregister, to check preregistrations, and noting deviations. But the most important step will be evaluating the impact of the deviations! There is almost no work on this. Good topic for a young metascientist!
New preprint: When and How to Deviate from a Preregistration osf.io/preprints/ps... I hope this helps researchers to reflect on the consequence of deviations from preregistrations by evaluating the test's severity and the validity of the inference.
December 18, 2023 at 8:48 AM
New preprint: When and How to Deviate from a Preregistration osf.io/preprints/ps... I hope this helps researchers to reflect on the consequence of deviations from preregistrations by evaluating the test's severity and the validity of the inference.
Deviations from preregistrations happen (pretty normal, IME), but how to best report those deviations?
This new template -developed from many sources, including a survey of editors- looks like a promising solution
📝 journals.sagepub.com/doi/full/10....
GDoc: docs.google.com/document/d/1...
This new template -developed from many sources, including a survey of editors- looks like a promising solution
📝 journals.sagepub.com/doi/full/10....
GDoc: docs.google.com/document/d/1...
February 24, 2024 at 5:04 PM
Deviations from preregistrations happen (pretty normal, IME), but how to best report those deviations?
This new template -developed from many sources, including a survey of editors- looks like a promising solution
📝 journals.sagepub.com/doi/full/10....
GDoc: docs.google.com/document/d/1...
This new template -developed from many sources, including a survey of editors- looks like a promising solution
📝 journals.sagepub.com/doi/full/10....
GDoc: docs.google.com/document/d/1...
I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.
December 15, 2023 at 6:50 AM
I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.