MetaROR
@metaror.bsky.social
MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.
This new MetaROR-evaluated paper introduces "the innovation annulus: the zone between freely available structured data and the advancing frontier of commercially refined knowledge products," which is "a permanent, functional feature of the ecosystem -- not a pathology to eliminate."
👇 Read now
👇 Read now
Market dynamics, governance and open research metadata in the AI era - MetaROR
metaror.org
September 8, 2026 at 2:27 PM
This new MetaROR-evaluated paper introduces "the innovation annulus: the zone between freely available structured data and the advancing frontier of commercially refined knowledge products," which is "a permanent, functional feature of the ecosystem -- not a pathology to eliminate."
👇 Read now
👇 Read now
Here is the evaluation for "an empirical assessment of the inferential reproducibility of linear regression analyses in health and biomedical research". It demonstrates "substantial violations of key modelling assumptions" that often went unnoticed by authors and reviewers.
👇 Read it on MetaROR
👇 Read it on MetaROR
An empirical assessment of inferential reproducibility of linear regression in health and biomedical research papers - MetaROR
metaror.org
September 7, 2026 at 9:45 AM
Here is the evaluation for "an empirical assessment of the inferential reproducibility of linear regression analyses in health and biomedical research". It demonstrates "substantial violations of key modelling assumptions" that often went unnoticed by authors and reviewers.
👇 Read it on MetaROR
👇 Read it on MetaROR
2️⃣ Here is a revision of one of our first articles - a large-scale data-driven analysis of the use of initials vs. full first names in the author lists of scientific publications.
Reviewers were satisfied with the revisions made, though two of them still raised a few minor issues.
👇 Read it now
Reviewers were satisfied with the revisions made, though two of them still raised a few minor issues.
👇 Read it now
The rise and fall of the initial era - MetaROR
metaror.org
September 2, 2026 at 8:30 AM
2️⃣ Here is a revision of one of our first articles - a large-scale data-driven analysis of the use of initials vs. full first names in the author lists of scientific publications.
Reviewers were satisfied with the revisions made, though two of them still raised a few minor issues.
👇 Read it now
Reviewers were satisfied with the revisions made, though two of them still raised a few minor issues.
👇 Read it now
After two rounds of MetaROR evaluation, this article was just published in Scientometrics!
👏 Congratulations to the authors and everyone else involved.
👏 Congratulations to the authors and everyone else involved.
September 1, 2026 at 10:45 AM
After two rounds of MetaROR evaluation, this article was just published in Scientometrics!
👏 Congratulations to the authors and everyone else involved.
👏 Congratulations to the authors and everyone else involved.
2️⃣ The revision of this one is now up!
Both reviewers are highly satisfied with the (substantial) changes made to the article, and have no further comments.
🙏 Thanks and congratulations to all involved.
👇 Read both versions, including reviews and assessments, here metaror.org/article/rest...
Both reviewers are highly satisfied with the (substantial) changes made to the article, and have no further comments.
🙏 Thanks and congratulations to all involved.
👇 Read both versions, including reviews and assessments, here metaror.org/article/rest...
August 27, 2026 at 9:58 AM
2️⃣ The revision of this one is now up!
Both reviewers are highly satisfied with the (substantial) changes made to the article, and have no further comments.
🙏 Thanks and congratulations to all involved.
👇 Read both versions, including reviews and assessments, here metaror.org/article/rest...
Both reviewers are highly satisfied with the (substantial) changes made to the article, and have no further comments.
🙏 Thanks and congratulations to all involved.
👇 Read both versions, including reviews and assessments, here metaror.org/article/rest...
[1 / 3]
🔀 This study by @eumsoohong.bsky.social examines the interoperability between the South Korean national funder database and two bibliographic databases (Web of Science & OpenAlex).
👇 Read the full evaluation now on MetaROR
🔀 This study by @eumsoohong.bsky.social examines the interoperability between the South Korean national funder database and two bibliographic databases (Web of Science & OpenAlex).
👇 Read the full evaluation now on MetaROR
Assessing funders’ databases against bibliographic sources: A study of interoperability, metadata quality, and coverage using South Korea’s national R&D database - MetaROR
metaror.org
August 25, 2026 at 3:55 PM
[1 / 3]
🔀 This study by @eumsoohong.bsky.social examines the interoperability between the South Korean national funder database and two bibliographic databases (Web of Science & OpenAlex).
👇 Read the full evaluation now on MetaROR
🔀 This study by @eumsoohong.bsky.social examines the interoperability between the South Korean national funder database and two bibliographic databases (Web of Science & OpenAlex).
👇 Read the full evaluation now on MetaROR
♻️ How to detect reuse of data at scale? This article studies reuse of data sets shared by researchers from a biomedical research institution.
📝 The 3 reviewers are generally positive, calling the work 'thorough' & 'exciting' while providing detailed suggestions to improve it.
👇 Read now on MetaROR
📝 The 3 reviewers are generally positive, calling the work 'thorough' & 'exciting' while providing detailed suggestions to improve it.
👇 Read now on MetaROR
Matching data references and institutional output to map the reuse of biomedical research data - MetaROR
metaror.org
August 18, 2026 at 2:35 PM
♻️ How to detect reuse of data at scale? This article studies reuse of data sets shared by researchers from a biomedical research institution.
📝 The 3 reviewers are generally positive, calling the work 'thorough' & 'exciting' while providing detailed suggestions to improve it.
👇 Read now on MetaROR
📝 The 3 reviewers are generally positive, calling the work 'thorough' & 'exciting' while providing detailed suggestions to improve it.
👇 Read now on MetaROR
🌍 Can the polarity of sustainable development goals within news text be detected? That is the question raised by a new article, evaluated on the MetaROR platform.
👇 Read the full evaluation now on MetaROR
[1 / 3]
👇 Read the full evaluation now on MetaROR
[1 / 3]
Polarity detection of Sustainable Development Goals in news text - MetaROR
metaror.org
August 12, 2026 at 5:04 PM
🌍 Can the polarity of sustainable development goals within news text be detected? That is the question raised by a new article, evaluated on the MetaROR platform.
👇 Read the full evaluation now on MetaROR
[1 / 3]
👇 Read the full evaluation now on MetaROR
[1 / 3]
🔓 "Who chooses open peer review and is it an indicator of article quality?" That's the subject of "an observational study of PLOS journals" evaluated on MetaROR.
👇 Read on MetaROR
👇 Read on MetaROR
Who chooses open peer review and is it an indicator of article quality? An observational study of PLOS journals - MetaROR
metaror.org
August 11, 2026 at 12:44 PM
🔓 "Who chooses open peer review and is it an indicator of article quality?" That's the subject of "an observational study of PLOS journals" evaluated on MetaROR.
👇 Read on MetaROR
👇 Read on MetaROR
2️⃣ This one came back for a second evaluation round!
Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts.
👇 Read the full second (and first!) evaluation now on MetaROR
Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts.
👇 Read the full second (and first!) evaluation now on MetaROR
August 6, 2026 at 7:14 AM
2️⃣ This one came back for a second evaluation round!
Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts.
👇 Read the full second (and first!) evaluation now on MetaROR
Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts.
👇 Read the full second (and first!) evaluation now on MetaROR
Here is the revision of an article presenting an agent-based model of citation behavior and compares citation networks generated by this model with real-world citation networks.
Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues.
👇 Read now on MetaROR
Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues.
👇 Read now on MetaROR
Modeling the global citation network using the scalable agent-based simulator for citation analysis with recency-emphasized sampling (SASCA-ReS) - MetaROR
metaror.org
August 3, 2026 at 2:40 PM
Here is the revision of an article presenting an agent-based model of citation behavior and compares citation networks generated by this model with real-world citation networks.
Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues.
👇 Read now on MetaROR
Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues.
👇 Read now on MetaROR
This one has come back from (extensive) revision! The reviewers applaud the changes, yet still highlight some issues; in particular with regard to the title suggesting generic as opposed to specifically biomedical application.
🙏 Thanks again to all those involved!
👇 Read the evaluation on MetaROR
🙏 Thanks again to all those involved!
👇 Read the evaluation on MetaROR
July 30, 2026 at 4:12 PM
This one has come back from (extensive) revision! The reviewers applaud the changes, yet still highlight some issues; in particular with regard to the title suggesting generic as opposed to specifically biomedical application.
🙏 Thanks again to all those involved!
👇 Read the evaluation on MetaROR
🙏 Thanks again to all those involved!
👇 Read the evaluation on MetaROR
🌐 How accessible are preprint services and where are they located? That is the question addressed by this article evaluated by MetaROR.
The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests.
👇 Read it now
The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests.
👇 Read it now
The localisation and accessibility of preprint services: implications for Open Science - MetaROR
metaror.org
July 29, 2026 at 10:08 AM
🌐 How accessible are preprint services and where are they located? That is the question addressed by this article evaluated by MetaROR.
The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests.
👇 Read it now
The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests.
👇 Read it now
💭 Why is change in scholarly communication so hard to imagine?
This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing.
Reviewers were generally positive but urged the authors to include more detail and potential solutions.
👇 Read now on MetaROR
This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing.
Reviewers were generally positive but urged the authors to include more detail and potential solutions.
👇 Read now on MetaROR
Why is change in scholarly communication so hard to imagine? Findings from a stakeholder consultation for the cOAlition S proposal ‘Towards Responsible Publishing’ - MetaROR
metaror.org
July 28, 2026 at 11:40 AM
💭 Why is change in scholarly communication so hard to imagine?
This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing.
Reviewers were generally positive but urged the authors to include more detail and potential solutions.
👇 Read now on MetaROR
This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing.
Reviewers were generally positive but urged the authors to include more detail and potential solutions.
👇 Read now on MetaROR
👏 Great initiative by our friends at PREreview!
🎉 We’re celebrating #PeerReviewWeek with a Review-a-thon!
Gather your lab, classroom, department, or community to review preprints or datasets as a team, in any language or research field. You can win a prize to support your Club's activities!
Learn more & register by Aug. 31: bit.ly/Review-a-thon
Gather your lab, classroom, department, or community to review preprints or datasets as a team, in any language or research field. You can win a prize to support your Club's activities!
Learn more & register by Aug. 31: bit.ly/Review-a-thon
July 27, 2026 at 8:49 AM
👏 Great initiative by our friends at PREreview!
This research plan outlines a study investigating how people perceive researchers who commit questionable research practices (investigators) compared to those who report them (inspectors).
👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR
[1/3]
👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR
[1/3]
From misconduct to reform: Understanding perceptions of those who commit & call out questionable research practices - MetaROR
metaror.org
July 23, 2026 at 8:34 AM
This research plan outlines a study investigating how people perceive researchers who commit questionable research practices (investigators) compared to those who report them (inspectors).
👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR
[1/3]
👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR
[1/3]
What is the relative efficiency of one- and two-stage research funding processes? This article studies that, concluding that two-stage processes “may lead to significant cost savings”.
👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
Insights into the relative efficiency of one- and two-stage research funding processes using an Agent Based Modelling approach - MetaROR
metaror.org
July 22, 2026 at 1:46 PM
What is the relative efficiency of one- and two-stage research funding processes? This article studies that, concluding that two-stage processes “may lead to significant cost savings”.
👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
Reposted by MetaROR
and Zhicheng's extensive response to the reviews is here metaror.org/article/rest... , with the revised version now undergoing a second round of review.
Restructuring scientific papers for human and AI readers - MetaROR
metaror.org
June 8, 2026 at 12:39 AM
and Zhicheng's extensive response to the reviews is here metaror.org/article/rest... , with the revised version now undergoing a second round of review.
This article proposes restructuring scientific papers, with front-loaded narratives for humans as well as machine-readable appendices.
Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing.
👇 Full assessment on MetaROR
Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing.
👇 Full assessment on MetaROR
Restructuring scientific papers for human and AI readers - MetaROR
metaror.org
June 5, 2026 at 11:49 AM
This article proposes restructuring scientific papers, with front-loaded narratives for humans as well as machine-readable appendices.
Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing.
👇 Full assessment on MetaROR
Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing.
👇 Full assessment on MetaROR
📝 Do preregistration & registered reports restrict exploratory research? This research plan aims to find out.
The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet.
👇 Read the full research plan, editorial assessment & reviews now on MetaROR
The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet.
👇 Read the full research plan, editorial assessment & reviews now on MetaROR
Evaluating the claim that preregistration and registered reports restrict exploratory research - MetaROR
metaror.org
June 4, 2026 at 10:34 AM
📝 Do preregistration & registered reports restrict exploratory research? This research plan aims to find out.
The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet.
👇 Read the full research plan, editorial assessment & reviews now on MetaROR
The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet.
👇 Read the full research plan, editorial assessment & reviews now on MetaROR
A second version of this article has now been evaluated - one of the reviewers of the original deems it "very good" and feels comments were adequately addressed.
🙏 Thanks again for everyone involved in making this happen!
📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
🙏 Thanks again for everyone involved in making this happen!
📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
May 29, 2026 at 7:13 AM
A second version of this article has now been evaluated - one of the reviewers of the original deems it "very good" and feels comments were adequately addressed.
🙏 Thanks again for everyone involved in making this happen!
📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
🙏 Thanks again for everyone involved in making this happen!
📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines.
Reviewers praised it as timely & useful while providing recommendations.
Read it now 👇
Reviewers praised it as timely & useful while providing recommendations.
Read it now 👇
Handbook for Reproduction and Replication Studies - MetaROR
metaror.org
May 6, 2026 at 8:04 AM
🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines.
Reviewers praised it as timely & useful while providing recommendations.
Read it now 👇
Reviewers praised it as timely & useful while providing recommendations.
Read it now 👇
Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries.
Reviewers recognize the approach's value & also provide (literature) suggestions.
👇 Read the assessment, reviews and full text on MetaROR
Reviewers recognize the approach's value & also provide (literature) suggestions.
👇 Read the assessment, reviews and full text on MetaROR
The relative intensity of bilateral and multilateral co-authorship with Russia since 1995 - MetaROR
metaror.org
April 21, 2026 at 12:50 PM
Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries.
Reviewers recognize the approach's value & also provide (literature) suggestions.
👇 Read the assessment, reviews and full text on MetaROR
Reviewers recognize the approach's value & also provide (literature) suggestions.
👇 Read the assessment, reviews and full text on MetaROR
This article, which went through two rounds of MetaROR evaluation, just got published in Quantitative Science Studies!
👏 Congratulations to the authors!
Read it here: direct.mit.edu/qss/article/...
👏 Congratulations to the authors!
Read it here: direct.mit.edu/qss/article/...
April 8, 2026 at 1:59 PM
This article, which went through two rounds of MetaROR evaluation, just got published in Quantitative Science Studies!
👏 Congratulations to the authors!
Read it here: direct.mit.edu/qss/article/...
👏 Congratulations to the authors!
Read it here: direct.mit.edu/qss/article/...
Reposted by MetaROR
Our two Iranian co-authors, Saeed Shafiei Sabet of the University of Guilan and Marziyeh Amini Fard may not know about these positive reviews for our manuscript, because my emails to them continue to bounce. I wanted to recognize them here because I'm very concerned about their future.
🗨️ This article's authors announce expansion of CRediT into 36 languages & describe how translations from English were made.
Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT.
👇 Read the full evaluation
Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT.
👇 Read the full evaluation
Facilitating multilingual research publishing: Translations of the Contributor Roles Taxonomy (CRediT) - MetaROR
metaror.org
April 6, 2026 at 7:43 AM
Our two Iranian co-authors, Saeed Shafiei Sabet of the University of Guilan and Marziyeh Amini Fard may not know about these positive reviews for our manuscript, because my emails to them continue to bounce. I wanted to recognize them here because I'm very concerned about their future.