#NaturalExperiments
Tasked to write a review on #naturalexperiments in #clinical #medicine, we realized it was necessary/inevitable to include a few paragraphs on #partialidentification at the end.

Explainer by @johnmullahy.bsky.social, @dlmillimet.bsky.social, Manski, me here: pmc.ncbi.nlm.nih.gov/articles/PMC...
December 6, 2024 at 4:07 PM
1/ #NaturalExperiments are increasingly being used to answer #clinicalquestions, like how does treatment X affect disease outcome Y.

Recent review by Lizzie Bair and me in NEJM Evidence covers examples and best practices for these types of studies:

evidence.nejm.org/doi/full/10....
Natural Experiments to Inform Clinical Practice
Natural experiments refer to events or practices that result in similar individuals receiving different services or interventions for arbitrary reasons. In the clinical context, researchers may wis...
evidence.nejm.org
September 5, 2025 at 4:42 PM
You can see my enthusiasm for #naturalexperiments wane over the course of this paper, even as difference-in-differences takes over medical journals.

evidence.nejm.org/doi/abs/10.1...
Natural Experiments to Inform Clinical Practice
Natural experiments refer to events or practices that result in similar individuals receiving different services or interventions for arbitrary reasons. In the clinical context, researchers may wis...
evidence.nejm.org
February 1, 2026 at 6:38 PM
It seems it is going to be an interesting period for #naturalexperiments in the US, in which we shall see the impact of withdrawal of #publichealth policies, interventions and infrastructure (and new odd ones). Great for #causalinference, but probably for most at the expense of US residents.
November 15, 2024 at 12:20 PM
Aspiring labor economists hoping to do research on U.S. minimum wage topics should also vehemently oppose indexation. #naturalexperiments.
December 2, 2024 at 10:15 PM
It turns out the assumptions required to adopt typically used natural experiments to inform specific clinical scenarios (as opposed to typical health policy questions) are quite strong.

#HealthPolicy #NaturalExperiments #ClinicalResearch #NEJMEvidence
April 29, 2025 at 12:43 PM
#Naturalexperiments are showing why the US policy of defunding national and local government can be a bad idea if done carelessly, and can have serious consequences.

Here, on defunding the effect on the weather service in Texas in relation to recent events (in Dutch):

www.ad.nl/buitenland/w...
Wie heeft schuld aan ruim 50 doden en 27 vermiste meisjes? ‘Weerdienst Texas heeft groot personeelstekort’
De autoriteiten in Texas onderschatten het gevaar van de hevige regenval afgelopen dagen, omdat de weerdienst cruciale informatie niet op tijd kon doorgeven. Dat kwam door groot personeelsgebrek, meld...
www.ad.nl
July 6, 2025 at 8:46 AM
I haven't read www.acpjournals.org/doi/10.7326/... in detail yet, so no idea who is right on #covid19 mask mandates, but evaluations of #naturalexperiments using different analytic methods, controls, and falsification is excellent

As recommended😆: bmcmedresmethodol.biomedcentral.com/articles/10....
Conceptualising natural and quasi experiments in public health - BMC Medical Research Methodology
Background Natural or quasi experiments are appealing for public health research because they enable the evaluation of events or interventions that are difficult or impossible to manipulate experiment...
bmcmedresmethodol.biomedcentral.com
October 8, 2024 at 8:04 AM
2/ One thing I learned in working on this is that the #naturalexperiments we use for #health #policy may not be well suited to *specific* clinical questions. Knowledge of the institutional context becomes even more key.

We conclude our review with a short section on partial identification.
September 5, 2025 at 4:42 PM