#replicability
Yup: "We must therefore go beyond ‘standards’ and embrace a cultural shift wherein scholarly success values quality over quantity, openness above opacity, and robust replicability instead of fleeting novelty."

doi.org/10.3102/0034...
November 17, 2026 at 3:05 PM
And the scientific method relies on replicability, scrutiny from peers, and networked knowledge to the degree that small tribes would blunder into scientific dead ends without cobbling together at least some networked form of larger social structure (assuming ideal relations between said groups)
November 16, 2026 at 8:27 PM
It’s funny that using LLM’s switches the problem from one of production to replicability, because it’s somehow enabled bespoke mass production on a one to many basis, despite its intrinsically random behavior
November 16, 2026 at 2:17 AM
A new study presents "Replica," a scalable platform designed to enhance research replicability using AI. By post-training the AI agent Faraday, researchers achieved superior performance in replication tasks, showing potential for AI-driven scientific innovation. https://arxiv.org/abs/2608.13331
[2608.13331] Training AI Scientists to Replicate Research
A new study presents "Replica," a scalable platform designed to enhance research replicability using AI. By post-training the AI agent Faraday, researchers achieved superior performance in replication
arxiv.org
November 17, 2026 at 8:00 AM
Gambling, Saving and Lumpy Liquidity Needs - A Reproducibility and Replicability Assessment of Herskowitz (2021): Rose, Julian
NEP/RePEc link
to paper
d.repec.org
November 16, 2026 at 7:58 AM
Nevermind replicability of results. When building a report over time or that needs to be run over and over I would much prefer Excel or any other method than have an LLM regenerate things every time. Not only the everything else, but it never matches!

It feels like this should be obvious but it's..
November 17, 2026 at 4:48 PM
Building Nations through Shared Experiences: Evidence from African Football - A Reproducibility and Replicability Assessment of Depetris-Chauvin et al. (2020): Lange, Martin
NEP/RePEc link
to paper
d.repec.org
November 16, 2026 at 5:58 AM
A feasibility study about the real study and then a pilot to test the real study with a followup on the results of the first pilot which was smaller so replicability is iffy so a second larger pilot or staged rollout with a larger more comprehensive study and a recommendations
November 14, 2026 at 3:37 AM
ah yeah we made the point a bit here: Forbes, S. H., Aneja, P., & Guest, O. (2022). The Myth of Normative Development. Infant and Child Development. doi.org/10.1002/icd.... pdf: osf.io/download/n29...
The myth of normative development
Over the past decade, the field of psychology has come under increasing fire for the replicability of purported findings, for the transparency of the methods used, and for the generalisability of th...
doi.org
November 18, 2026 at 1:37 PM
Most single-arm performance goals can't be reproduced from what the study reports: no source cohort, no derivation. Not a comparator. #HTA #EvidenceSynthesis
https://www.mattheneus.com/editorial/single-arm-performance-goal-derivation-replicability-evidence-2026-11-17
November 17, 2026 at 5:13 PM
Did you know that AI can now even reanalyze published data on its own and show flaws in published articles that passed human peer review?
replicationindex.com/2026/11/13/a...
Replicability-Index
AI enhanced post-publication peer-review. AI is more capable than many human reviewers and can reanalyze data to reveal flaws in published articles.
replicationindex.com
November 13, 2026 at 10:26 PM
"The Long-Term Impact of International Migration on Economic Decision-Making: Evidence from a Migration Lottery and Lab-in-the-Field Experiments" - A Reproducibility and Replicability Assessment of Gibson et al. (2019): Rose, Julian
NEP/RePEc link
to paper
d.repec.org
November 16, 2026 at 10:55 AM
📚 今日のキーワード解説 (2/10)

Self-Report(自己報告) / Deep Learning(深層学習) / Systematic Error(系統的誤差) / Replicability(再現可能性)

✉️ この論文の日本語解説はメールマガジンをご覧ください
https://mag.psycholo.studio/
November 13, 2026 at 11:00 PM
This is of course not a reason not to have folks dig into the data and find ways to interact with it and present it in a manner to help guide decisionmaking processes, but in the profession it is an emerging concern with bespoke AI workflows with data analysis and replicability.
November 10, 2026 at 8:32 PM
The Boundary of Subjectivity: Non-Conformist Will and the Paradox of Hyper-Rational Containment

The Scarcity of Metacognitive Autonomy and the Limits of Replicability The human capacity to resist psychological manipulation and maintain an unyielding internal compass represents a rare psychological…
The Boundary of Subjectivity: Non-Conformist Will and the Paradox of Hyper-Rational Containment
The Scarcity of Metacognitive Autonomy and the Limits of Replicability The human capacity to resist psychological manipulation and maintain an unyielding internal compass represents a rare psychological posture requiring hyper-developed metacognition. However, attempting to scale this individual autonomy across a broader population via education collides with a fundamental biological wall. Human cognitive architecture evolved to conserve energy by defaulting to heuristics, social consensus, and authority. Expecting a society to universally internalize rigorous non-conformist critical thinking requires defying the basic energy-saving mechanics of biological evolution. Consequently, the fraction of any population capable of resisting sophisticated systemic framing remains inherently small.
molamola.live
November 15, 2026 at 7:16 AM
How AI survey data can fall short despite looking reliable: Our study shows that while structured AI setups can produce remarkably consistent survey answers across repeated runs, those synthetic responses still frequently fail to match what real people say.
Consistently Wrong: Why AI Survey Samples Can Replicate Themselves but Still Miss Human Reality
Jahn, Klinke, Guhl & Murr: “Re-fielding Replicability of Silicon Sample-based Marketing Research“ CRC Discussion Paper No. 583
190researchblog.substack.com
November 16, 2026 at 12:00 PM
animsci.peercommunityin.org has recently endorsed the preprint at https://doi.org/10.64898/2026.04.19.718108

The recommendation was handled by Birte L Nielsen
and is available at https://doi.org/10.24072/pci.animsci.100566
On the intra-laboratory replicability of results in animal cognition research, obtained in animals that were not exposed to, or unaffected by, experimental manipulations — Exemplified by spatial learning in pigs (Sus Scrofa Domesticus) across 12 holeboard studies
The replicability of experimental results is considered a cornerstone of empirical research. However, the reproducibility of results from groups that have not undergone experimental manipulation — the standard against which comparisons in an experiment are made — has been almost entirely neglected in animal research. Our aim is to address this gap by exemplarily determining within-laboratory replicability using research in pigs, an increasingly popular large animal model species. Drawing on data from twelve independent porcine holeboard studies conducted in our laboratory, we examine the replicability of groups that were not subjected to experimental manipulation (typically the control group), eventually including groups on which the experimental treatments had no effect. These analyses were also performed on all eight studies involving the Terra x Finnish Landrace x Duroc pig breed, with all other breeds excluded to increase genetic uniformity. The holeboard is a complex spatial discrimination task in which an animal must learn to find food at four of sixteen possible locations (holes) arranged in a 4 × 4 matrix. The main variables measured are spatial working memory (WM), reference memory (RM) and the inter-visit interval (IVI), which serve as an index of motivation. All studies showed predominantly linear improvements in WM and learning rates across successive trialblocks. IVI showed greater variation across trialblocks, but this did not affect WM and RM learning, which are robust and replicable indices of spatial learning in pigs. Assessing replicability provides relevant information, such as whether behavioural and physiological traits in a model species are stably expressed and robust across studies. Including replicability research and publishing its results can stimulate the development and use of more replicable methods and workflows, thereby increasing scientific rigor. Provided the data are available and accessible, the next step should be to expand replicability studies to include those conducted in different laboratories. ### Competing Interest Statement The authors have declared no competing interest.
www.biorxiv.org
November 13, 2026 at 7:50 AM
animsci.peercommunityin.org has recently reviewed the preprint at https://doi.org/10.64898/2026.04.19.718108

The review was handled by Teun Schuurman
and is available at https://animsci.peercommunityin.org/articles/rec?id=566#review-2249
On the intra-laboratory replicability of results in animal cognition research, obtained in animals that were not exposed to, or unaffected by, experimental manipulations — Exemplified by spatial learning in pigs (Sus Scrofa Domesticus) across 12 holeboard studies
The replicability of experimental results is considered a cornerstone of empirical research. However, the reproducibility of results from groups that have not undergone experimental manipulation — the standard against which comparisons in an experiment are made — has been almost entirely neglected in animal research. Our aim is to address this gap by exemplarily determining within-laboratory replicability using research in pigs, an increasingly popular large animal model species. Drawing on data from twelve independent porcine holeboard studies conducted in our laboratory, we examine the replicability of groups that were not subjected to experimental manipulation (typically the control group), eventually including groups on which the experimental treatments had no effect. These analyses were also performed on all eight studies involving the Terra x Finnish Landrace x Duroc pig breed, with all other breeds excluded to increase genetic uniformity. The holeboard is a complex spatial discrimination task in which an animal must learn to find food at four of sixteen possible locations (holes) arranged in a 4 × 4 matrix. The main variables measured are spatial working memory (WM), reference memory (RM) and the inter-visit interval (IVI), which serve as an index of motivation. All studies showed predominantly linear improvements in WM and learning rates across successive trialblocks. IVI showed greater variation across trialblocks, but this did not affect WM and RM learning, which are robust and replicable indices of spatial learning in pigs. Assessing replicability provides relevant information, such as whether behavioural and physiological traits in a model species are stably expressed and robust across studies. Including replicability research and publishing its results can stimulate the development and use of more replicable methods and workflows, thereby increasing scientific rigor. Provided the data are available and accessible, the next step should be to expand replicability studies to include those conducted in different laboratories. ### Competing Interest Statement The authors have declared no competing interest.
www.biorxiv.org
November 13, 2026 at 7:49 AM
animsci.peercommunityin.org has recently reviewed the preprint at https://doi.org/10.64898/2026.04.19.718108

The review was handled by (anonymous)
and is available at https://animsci.peercommunityin.org/articles/rec?id=566#review-2099
On the intra-laboratory replicability of results in animal cognition research, obtained in animals that were not exposed to, or unaffected by, experimental manipulations — Exemplified by spatial learning in pigs (Sus Scrofa Domesticus) across 12 holeboard studies
The replicability of experimental results is considered a cornerstone of empirical research. However, the reproducibility of results from groups that have not undergone experimental manipulation — the standard against which comparisons in an experiment are made — has been almost entirely neglected in animal research. Our aim is to address this gap by exemplarily determining within-laboratory replicability using research in pigs, an increasingly popular large animal model species. Drawing on data from twelve independent porcine holeboard studies conducted in our laboratory, we examine the replicability of groups that were not subjected to experimental manipulation (typically the control group), eventually including groups on which the experimental treatments had no effect. These analyses were also performed on all eight studies involving the Terra x Finnish Landrace x Duroc pig breed, with all other breeds excluded to increase genetic uniformity. The holeboard is a complex spatial discrimination task in which an animal must learn to find food at four of sixteen possible locations (holes) arranged in a 4 × 4 matrix. The main variables measured are spatial working memory (WM), reference memory (RM) and the inter-visit interval (IVI), which serve as an index of motivation. All studies showed predominantly linear improvements in WM and learning rates across successive trialblocks. IVI showed greater variation across trialblocks, but this did not affect WM and RM learning, which are robust and replicable indices of spatial learning in pigs. Assessing replicability provides relevant information, such as whether behavioural and physiological traits in a model species are stably expressed and robust across studies. Including replicability research and publishing its results can stimulate the development and use of more replicable methods and workflows, thereby increasing scientific rigor. Provided the data are available and accessible, the next step should be to expand replicability studies to include those conducted in different laboratories. ### Competing Interest Statement The authors have declared no competing interest.
www.biorxiv.org
November 13, 2026 at 7:49 AM
Only half of studies in the #SocialSciences demonstrate #reproducibility or #replicability, according to a seven-year investigative project.
We look at why there are nevertheless grounds for optimism
www.horizons-mag.ch/2026/09/03/re…
November 12, 2026 at 7:00 AM
While there have been previous papers highlighting the non-replicable nature of backfire effects, the current findings provide a potential mechanism for this poor replicability.
November 11, 2026 at 11:41 AM
#PersonalityScience Blast from the past, the problems of EFA were known in 1971 by leading personality researchers, but the EFA paradigm persisted for another 50 years, Why?

replicationindex.com/2026/11/11/d...
David Lykken’s (1971) Critique of Exploratory Factor Analysis Is Still Valid - Replicability-Index
Reference: Lykken, D. T. (1971). Multiple factor analysis and personality research. Journal of Experimental Research in Personality, 5, 161–170. In 1971, David T. Lykken published a remarkable article...
replicationindex.com
November 11, 2026 at 4:57 PM
🚨 We have a new @i4replication.bsky.social Discussion Paper, "Gambling, Saving and Lumpy Liquidity Needs: A Reproducibility and Replicability Assessment of Herskowitz (2021)" (w/ @florianneubauer.bsky.social & Julian Rose) - read it here 👉 ideas.repec.org/p/zbw/i4rdps...
Gambling, Saving and Lumpy Liquidity Needs - A Reproducibili
Herskowitz (2021) investigates the relationship between unmet liquidity needs and the demand for gambling among sports bettors in Kampala, Uganda, using a combination of surveys, randomized field expe
ideas.repec.org
November 9, 2026 at 9:20 PM
This is worth a watch from @sholtodavid.bsky.social. Perhaps this could be a lab or department in research institution: "Accountability & Replicability Lab"
youtu.be/HXcrOkRUkLY
The World's Biggest Scientific Journal Suspended From PubMed: What Went Wrong?
YouTube video by Sholto David
youtu.be
November 8, 2026 at 5:50 PM