#Metascience
LightNews LightNews
jbakcoleman.bsky.social
Had my first email arising from what seems to be an LLM-guided spite-check of my published code.

Anyone else experienced this yet?

I'm pulling the repo and verifying the possible error, will happily correct if need be but this seems like a great way to DDoS scientists.

#metascience
#AcademicSky
September 27, 2026 at 3:32 PM
alfrednobel.bsky.social
This is precisely what we see throughout philosophy, psychology, and metascience. Metascience is itself a legitimate scientific field, and some researchers rightly make it their highest priority. Yet the broader problem remains: we
September 26, 2026 at 3:08 PM
recherche-psi.bsky.social
Clairvoyance : plus de 25 millions d'essais analysés par Wahbeh et ses collègues. Les séries de longueur fixée restent au niveau du hasard. Quel rôle joue l'arrêt optionnel ? Notre analyse :

https://recherche-psi.github.io/bulletins-recherche-psi/bulletins/2026-09-25-recherche-psi-metascience-osf/
September 25, 2026 at 12:27 PM
recherche-psi.bsky.social
Radin et Cline : un faible signal entre intention humaine et données optiques antérieures. Que permet de conclure ce protocole ? Analyse des résultats et de leurs limites dans le bulletin.

https://recherche-psi.github.io/bulletins-recherche-psi/bulletins/2026-09-25-recherche-psi-metascience-osf/
September 25, 2026 at 12:27 PM
recherche-psi.bsky.social
Le bulletin de la recherche psi du 25 septembre est paru : études expérimentales, métascience, évolution d'OSF et ouvrages. Disponible en français et en anglais.

https://recherche-psi.github.io/bulletins-recherche-psi/bulletins/2026-09-25-recherche-psi-metascience-osf/
September 25, 2026 at 12:27 PM
samuelmoore.org
"The system is not without flaws, but the metascience discussion is not likely to improve the system but rather to generate munition to undermine it"
September 25, 2026 at 12:10 PM
scurry.bsky.social
Good piece by David Matthews on political dilemmas for metascience. sciencebusiness.net/news/interna...
Is metascience being co-opted?
In July, the White House released a report that argued academia is deeply dysfunctional and in need of radical reform.
sciencebusiness.net
September 25, 2026 at 12:03 PM
impractknow.bsky.social
I wonder whether the UKRI funded research into AI and metascience has got something to do with the evidence that's been generated that this kind of funding system is a good idea
jpsastro.bsky.social John Stott @jpsastro.bsky.social · 3d
Had a UKRI funded grant proposal rejected at the "AI triage stage". "This AI-based triage was used only to identify approximately 50% of the strongest proposals to take forward to full human review." 🧪 #academicsky
I am writing to let you know that, unfortunately, your application was not successful. Review process As part of the initial triage of the 179 proposals submitted to this call, each was assessed using an AI-based review. Every proposal was read independently by several different AI models against the same seven criteria used to shape this call (including cyber security relevance, research quality and novelty, importance of the problem addressed, feasibility of the project plan, likely outputs and impact, value for money, and responsible research practice), with each model asked to give a score and a written justification with supporting quotations from the text. To guard against any one model's idiosyncrasies, we also ran a second, independent process in which different AI models debated the merits and weaknesses of each proposal before reaching a judgement, again against the same criteria. Scores from both processes were combined to produce an overall ranking. This AI-based triage was used only to identify approximately 50% of the strongest proposals to take forward to full human review. Projects selected for funding were drawn from those that progressed to the full human review stage. We recognise that AI-assisted assessment is a new and evolving part of the review process, and we are continuing to evaluate how well it aligns with the judgements of human reviewers on this call. We will soon produce a document detailing our method, so that others can build upon it and improve it. Feedback on your application Your application was not selected to progress beyond the AI triage stage. To provide transparency on the outcome of this assessment, we are sharing below the scores (out of 5) from each of the two AI review processes described above, together with the mean score across the two processes.
September 25, 2026 at 8:47 AM
petebachant.me
How to prevent this problem? Instrumentation stamping artifacts with cryptographically signed attestation for provenance? That could be useful for more than just fraud detection.

#metascience
sholtodavid.bsky.social Sholto David @sholtodavid.bsky.social · 7d
Today I'm posting a video about Neurodigitech LLC which has provided clearly photoshopped neurons to research teams that published these images in Nature, JBC, and more. A year after I uncovered this only one paper has been corrected. It's in Frontiers. youtu.be/4g_1_AWOVpI
Faked Images of Neurons in Major Journals
YouTube video by Sholto David
youtu.be
September 24, 2026 at 6:51 PM
sciencebusiness.net
🔬⚖️ As the US experiments with new ways of funding and organising science, the debate is increasingly about trade-offs! How fast should research systems change, and what might be lost along the way?
Read more here: sciencebusiness.net/news/interna...
Is metascience being co-opted?
In July, the White House released a report that argued academia is deeply dysfunctional and in need of radical reform.
sciencebusiness.net
September 24, 2026 at 3:36 PM
rorinstitute.bsky.social
The second issue of Meta Morsels by @scurry.bsky.social is live on RoRI's Substack, where we've gathered a selection of new writing on AI’s impact on social science, open-source hardware, and a proposed global panel on inequality: researchonresearchinstitute.substack.com/p/meta-morse...
Meta Morsels 2
A selection of new and notable writing on metascience
researchonresearchinstitute.substack.com
September 24, 2026 at 11:28 AM
scurry.bsky.social
*THIS WEEK* on the @rorinstitute.bsky.social Substack smorgasbord - pieces on the impacts of AI on social science and open science, and proposals for properly gearing research to tackle inequality. researchonresearchinstitute.substack.com/p/meta-morse...
Meta Morsels 2
A selection of new and notable writing on metascience
researchonresearchinstitute.substack.com
September 24, 2026 at 9:19 AM
randalljellis.bsky.social
We discussed the early days of registered reports, their 2.0 version at Peer Community In Registered Reports, the pushback they received early on, and why staying persistent in fighting for your ideas is so important.

Also available on Spotify: open.spotify.com/episode/1CpU...
Registered reports | Chris Chambers
Metascience Matters · Episode
open.spotify.com
September 23, 2026 at 9:40 PM
randalljellis.bsky.social
Here’s my conversation with Chris Chambers on Metascience Matters. Chris was the first journal editor to offer registered reports, starting in 2013 at Cortex.

youtu.be/PgZjgZlxsYw?...
Registered reports | Chris Chambers
YouTube video by Metascience Matters
youtu.be
September 23, 2026 at 9:40 PM
csetgeorgetown.bsky.social
⭐️ New Report ⭐️

This summer, CSET hosted a roundtable that brought together 16 experts in data science, metascience, and S&T policy as a part of our recently launched Project ATLAS!

Read more in our new roundtable report ⬇️ cset.georgetown.edu/publication/...
Creating ATLAS | Center for Security and Emerging Technology
How can we connect publication and patent data in new ways to derive useful insights into science and technology activity? How can we characterize these connections, visually or in natural language? T...
cset.georgetown.edu
September 23, 2026 at 8:10 PM
bernadettecogswell.bsky.social
Agreed. I’m using logic from the philosophy side of things and algorithm from the computer science side of things (with heuristic from psychology thrown in). It would be easier if they were all standard terms in some metascience middle ground. That’s the challenge of interdisciplinary discussions.
September 23, 2026 at 6:18 PM
devezer.bsky.social
The rise of metascience embodies and builds on this result-centric focus that has come to define the scientific endeavor over the past few decades. Maybe the backlash against AI will help us finally push back against this trend and bring the focus back to the context, process, assumptions & models.
psycnet.apa.org
September 23, 2026 at 4:51 PM
jbakcoleman.bsky.social
I'll grant you you've heard it... but I think if you looked at the network of academics publishing in AI Safety or Metascience; you'd see that there's a ton of money pouring into one perspective in each domain (Doomer/Boomer; Replication crisis) which skews perceptions but also lowers quality.
September 23, 2026 at 1:01 PM
rjwatt42.bsky.social
I suspect that, for better or worse, metascience will figure more in future REFs. You'd fit like a glove there with the extra benefit that your work sticks out as different which the REF likes ("originality").
September 23, 2026 at 10:12 AM
jbakcoleman.bsky.social
Oh there’s like a pretty big body of literature that gets shunted to the banner of “critical Metascience” that questions all of the replication crisis narratives they undergird things like LLM reproducibility or predicting replicability. Stuff like this:

arxiv.org/abs/2604.26268
The Difference Between "Replicable" and "Not replicable" is not Itself Scientifically Replicable
Replication studies estimate the replicability rate of scientific results by aggregating binary verdicts of experiments. Exact replications are rarely attainable, so most replication sequences are non...
arxiv.org
September 23, 2026 at 2:36 AM
jbakcoleman.bsky.social
I think a problem with models like cG is you invariably wind up funding folks who more or less agree with you, or disagree with you in the way you want them to and creating a bit of a scientific self heaven-banning. For example the Metascience stuff is a big ol echo chamber.
September 23, 2026 at 2:14 AM
syeducation.bsky.social
Maybe the real metascience was the friends we alienated along the way.
September 23, 2026 at 12:19 AM
sanjaysrivastava.com
I predict that this will make Moin as many friends in the qual research community as his metascience work on quant has made him there
syeducation.bsky.social moin syed @syeducation.bsky.social · 5d
New paper! Despite qualitative researchers claiming that generalizability is not a goal, their published work does indeed contain generalizable claims. We document this and provide recommendations for how all researchers can better calibrate their generalizability claims. doi.org/10.1177/2515...
article header for, "Qualitative Researchers Can and Do Generalize: Generalizability Claims in Qualitative Psychological Research". Metascience!
September 22, 2026 at 11:53 PM
w-plus-ebs.bsky.social
Hi #WplusEBS members! See this call for manuscripts:

"novel metascience research that examines the evolutionary human sciences as a scientific field — its people, its practices, its structure and its outputs."
September 22, 2026 at 7:35 PM
syeducation.bsky.social
New paper! Despite qualitative researchers claiming that generalizability is not a goal, their published work does indeed contain generalizable claims. We document this and provide recommendations for how all researchers can better calibrate their generalizability claims. doi.org/10.1177/2515...
article header for, "Qualitative Researchers Can and Do Generalize: Generalizability Claims in Qualitative Psychological Research". Metascience!
September 22, 2026 at 4:08 PM