#MetaSci
LightNews LightNews
markrubin.bsky.social
New study finds "larger sample sizes consistently enhanced perceived reliability..., whereas preregistration did not."

#MetaSci
How methodological cues shape trust in psychological research and legal judgements: a vignette study
Abstract. Over the past decade, psychology has embraced transparency and reproducibility reforms to address the replication crisis, raising the question of
doi.org
November 1, 2026 at 7:38 AM
markrubin.bsky.social
“Critics may suggest that leaning into narratives is relativistic and undermines scientific objectivity. We argue that research as narrative is firmly rooted in cultural and mindset pluralism. This approach engages with the complexity and messiness of everyday human life and psychology.”

#MetaSci
November 2, 2026 at 3:33 PM
load-dependent.eurosky.social
#stats #metasci
October 27, 2026 at 10:25 AM
markrubin.bsky.social
"Imposing externally fixed standards on scientific fields without taking the specific needs, aims, and constraints of the fields into account is unlikely to engender progress."

#MetaSci #PhilSci #STS
Holding Science to a Gold Standard Will Hold It Back | The Scientist
A metascientist pushes back against the unified and idealized vision of science embodied in NSF’s new Office of Metascience.
www.the-scientist.com
October 29, 2026 at 6:27 AM
ertrunnell.bsky.social
What does it really mean for an experimental model to be “validated?"

In an introduction to the latest issue of BJHS Themes, Lara Keuck and Angela N. H. Creager examine that question through the history of scientific testing.

#philsci #metasci #histsci
November 2, 2026 at 3:25 PM
markrubin.bsky.social
I also liked the important point that:

"Reporting at least one practice does not mean using QRPs frequently, systematically, or across a substantial proportion of one’s research"

#MetaSci #Methodology
October 23, 2026 at 12:58 PM
markrubin.bsky.social
Link to the paper:

osf.io/preprints/ps...

#MetaSci #Methodology
Everyone else does it? Self-reported and perceived questionable research practices in music psychology
Questionable research practices (QRPs) may inflate false-positive rates and have been surveyed in psychology, ecology, and education, but not in music psychology. In a survey, 198 researchers who had ...
osf.io
October 23, 2026 at 1:43 PM
markrubin.bsky.social
"(5) they have created a very stifling, cult-like atmosphere where it is hard for empiricists like me to work."

#MetaSci
October 20, 2026 at 10:57 PM
markrubin.bsky.social
"Examining these defensive strategies falls within the scope of the psychology of science, an emerging perspective that offers a novel understanding of scientific practice."

#PhilSci #AcademicSky #MetaSci #SciSci #Psychology
Abstract Responding to a recent call for the development of a psychology of science, we examine how scientists manage empirical anomalies, a routine yet consequential challenge in scientific practice, and how their responses shape theory development. We argue that defensive anomaly-reduction strategies, which allow researchers to preserve an initial theoretical claim, can generate important secondary benefits. During the emergence phase of a theory, they foster auxiliary revisions that may reduce underfitting and place a fragile theory on a growth trajectory. During the exploitation phase of established theories, they help sustain attention to problems derived from the theory and support cumulative research. However, their accumulation may also increase the risk of overfitting, reduce predictive power, and set the theory on a degenerative trajectory. We illustrate these dynamics primarily through examples drawn from psychological theories, with a focus on responses to replication failures. Last, we derive several implications for peer review aimed at fostering scientific innovation. In particular, we propose shifting evaluation away from the consistency of findings, which may penalize emerging research programs and hinder innovation, and toward how inconsistencies are managed, thereby fostering growth trajectories, including for mature programs confronted with anomalies.
October 23, 2026 at 5:05 PM
markrubin.bsky.social
“When correction is viewed as portrayed in Fig. 1, one may see similarities to the general dynamics of an adaptive system, such as the immune response or natural selection (e.g., Lewontin, 1970; Plotkin, 1997), sometimes viewed as “corrective” in nature.”

#Methodology #PhilSci #MetaSci #AcademicSky
October 20, 2026 at 2:20 PM
reproducibilitea.org
💡 Post-publication review as a digital colloquium - a new blog post by Adrien Fillon @adrienfillon.bsky.social

reproducibilitea.org/jc/2026/10/1...

#PostPublicationReview #PeerReview #OpenResearch #metasci #academicsky #researchsky
Post-publication review as a digital colloquium
The central question of science is: how can we improve our scientific theories?
reproducibilitea.org
October 20, 2026 at 11:52 AM
redteamofsci.bsky.social
open.substack.com/pub/redteamo... #metasci
A review of Google’s AI paper checker
Deep Review is impressive, flawed, and historic
open.substack.com
October 19, 2026 at 1:50 PM
devezer.bsky.social
it's like a little time travel to 2017 twitter. like nothing's changed, no flashy mega-replication has been retracted, no zombie metasci stats have been published. like even metasci conf hasn't decided to refocus on critical assessment. same self-righteous, knowledge-resistant vitriol lives on.
October 16, 2026 at 9:27 PM
load-dependent.eurosky.social
Never let anyone publish meta-analyses that mix confounded observational studies with randomised trials. #metasci #cardiosky
papertis.bsky.social Papertis @papertis.bsky.social · 26d
Bivalirudin vs heparin in PCI for ACS.

28 studies, 584,249 patients: lower 30-day mortality (RR 0.85) and major bleeding (RR 0.59) with bivalirudin. No difference in MI. 17 of 28 studies were cohorts.

Yang, Li et al. Medicine 2026

https://pubmed.ncbi.nlm.nih.gov/42798052/
#MedSky #CardioSky
Bivalirudin vs heparin in PCI for ACS. Medicine · 2026 · 28 studies, 584,249 patients. RR 0.59: 30-day major bleeding with bivalirudin. 17 of 28 studies were cohorts; no difference in MI, stent thrombosis or stroke.
October 7, 2026 at 1:53 PM
markrubin.bsky.social
“Our analyses thus contribute to a growing literature documenting the limited clarity of pre-analysis plans in the social sciences and the prevalence of undocumented deviations from preregistration (Brodeur et al., 2024; Franco et al., 2016; Ofosu and Posner, 2023).”

#MetaSci #Methodology
October 7, 2026 at 10:27 AM
redteamofsci.bsky.social
open.substack.com/pub/redteamo... #metasci
Throwing spaghetti at the wall
A familiar genetic finding makes it into The New York Times
open.substack.com
October 4, 2026 at 3:47 PM
bernadettecogswell.bsky.social
Question: what is the difference between a “logic” and an “algorithm”? If I have a “logic of discovery” versus an “algorithm for discovery“ how are they different? I want to give summary bullet points to students in a course. But we don’t use these concepts in physics.

#philsci #scisci #metasci
September 22, 2026 at 6:37 PM
insightfulscientist.com
Fascinating reading. We hope to see more needed studies like these.

#scisci #metasci #academicsky

www.nature.com/articles/s41...
New tools drive scientific discovery: evidence from all nobel-prize and major non-nobel breakthroughs - Humanities and Social Sciences Communications
Humanities and Social Sciences Communications - New tools drive scientific discovery: evidence from all nobel-prize and major non-nobel breakthroughs
www.nature.com
September 16, 2026 at 6:25 PM
markrubin.bsky.social
Chapter in the new Routledge Handbook of Values and Science

#MetaSci #PhilSci
The Routledge Handbook of Values and Science | Kevin C. Elliott, Ted R
This is the first-ever handbook to cover the vibrant philosophical literature on values and science.  Its 45 chapters—appearing in print here for the first
www.taylorfrancis.com
September 12, 2026 at 5:34 PM
danhicks.bsky.social
#philsci #metasci
September 11, 2026 at 8:56 PM
markrubin.bsky.social
"Staff members at the agency, who spoke on the condition of anonymity out of fear of retaliation, are concerned that the changes will lead to further cuts for work that has long been core to the agency’s mission: discovery-focused research, led by the curiosity of scientists."

#AcademicSky #MetaSci
NSF moves to overhaul funding approach in line with White House priorities
The major funder of basic science has not said how its new initiatives will be funded — but staff worry streamlined approach will further squeeze cash for core sciences.
www.nature.com
September 12, 2026 at 7:56 AM
bernadettecogswell.bsky.social
Aloha Bluesky!

I'm Bernadette, founder of The Insightful Scientist. We help researchers use scientific discovery as a force for good. Also, we’re based in Hawai’i. Happy to join researchers and thinkers here. What discoveries are on your mind right now?

#scisci #philsci #histsci #citsci #metasci
September 11, 2026 at 4:24 AM
mvranka.bsky.social
this amazing #metasci event (again!) somehow flew under my radar - paulmeehlschool.github.io/workshops/sy... - although submissions are closed, registration is still open, so check it out! (I will squeez my very limited budget and try joining as well!) @youngmetascience.bsky.social
September 9, 2026 at 9:56 AM
markrubin.bsky.social
Changes in economics research from 1998 to 2019:

🔸️ "Pre-analysis plans, power analyses accompanying null results, and corrections for multiple hypothesis testing remain uncommon."

🔸️ "Articles now report more tables and statistical tests."

doi.org/10.1016/j.eu...

#Economics #MetaSci #Methodology
Abstract We map the evolution of economics research from 1998 to 2019 to assess progress and identify remaining challenges. Using text mining of 30,675 full-text articles and an in-depth analysis of 578,132 statistical tests from 3746 articles across a broad range of journals, we document changes in research practices over time. We highlight the influence of the credibility revolution and the open science movement. Awareness of reproducibility has increased modestly, largely driven by journal adoption of data and code sharing policies. At the same time, reliance on non-public data has grown, especially among authors at top-five universities, posing new challenges for transparency. Sample sizes have increased substantially, while reported effect sizes have declined, consistent with reduced exaggeration and potentially more policy-relevant estimates. Econometric methods and causal inference practices have become more sophisticated, and articles now report more tables and statistical tests. However, pre-analysis plans, power analyses accompanying null results, and corrections for multiple hypothesis testing remain uncommon. Article length has remained stable or declined slightly, and authors from top-five universities continue to represent a large and stable share of publications in top journals. Our findings provide a baseline for tracking future developments and for guiding efforts to further strengthen the credibility and transparency of economics research.
August 30, 2026 at 9:50 PM
markrubin.bsky.social
"The lack of consensus on persuasion’s ethical boundaries underscores the need for further investigation and deeper reflection within the scientific community."

doi.org/10.36850/b36...

#MetaSci #STS #PhilSci #Epistemology
August 30, 2026 at 8:14 AM