My usual rebuttal to “biggest percent change!” is “yeah, but what abt the absolute change?”
Which here? Also the biggest of all time.
My usual rebuttal to “biggest percent change!” is “yeah, but what abt the absolute change?”
Which here? Also the biggest of all time.
I swear to God, percentages and the baserate problem are one of the single greatest threats to sound policy, and I’m not really being hyperbolic.
MEMPHIS POLICE: “Those crimes are actually down.”
🤷🏼♀️ 🚂 (h/t @NoApologies901)
I swear to God, percentages and the baserate problem are one of the single greatest threats to sound policy, and I’m not really being hyperbolic.
But the absolute decline *just since 2022* has been the biggest in modern history—even compared to the 2000s, which has a comparable baserate.
And crickets on that too.
So it’s not a rates-vs-absolutes issue—it’s a deeper problem.
But the absolute decline *just since 2022* has been the biggest in modern history—even compared to the 2000s, which has a comparable baserate.
And crickets on that too.
So it’s not a rates-vs-absolutes issue—it’s a deeper problem.
The baserate fallacy is real and omnipresent.
(The post I’m subtweeting isn’t worth flagging, but any time I see that line I feel the need to raise the baserate fallacy alarm.)
The baserate fallacy is real and omnipresent.
(The post I’m subtweeting isn’t worth flagging, but any time I see that line I feel the need to raise the baserate fallacy alarm.)
Jonathan Haidt support? ✅
Article later admits most kids are actually taking types of non-home classes, just in a different form, bc admit officers don’t trust parent grades? ✅
Clear selection bias of wealthy parents w big tutoring and college counseling budgets? ✅
Jonathan Haidt support? ✅
Article later admits most kids are actually taking types of non-home classes, just in a different form, bc admit officers don’t trust parent grades? ✅
Clear selection bias of wealthy parents w big tutoring and college counseling budgets? ✅
Pure uncut baserate fallacy correction.
It was (no snark) a HUGE public service.
Pure uncut baserate fallacy correction.
But it's still likely a pretty inefficient one (in part bc of that baserate issue).
But it's still likely a pretty inefficient one (in part bc of that baserate issue).
journals.sagepub.com/doi/10.1177/...
journals.sagepub.com/doi/10.1177/...
1. Stop making baserate errors (big percent change likely means NOT that important).
2. Stop selecting on the dependent variable.
(My 1Ls this afternoon are about to get an unexpected stats class.)
1. Stop making baserate errors (big percent change likely means NOT that important).
2. Stop selecting on the dependent variable.
(My 1Ls this afternoon are about to get an unexpected stats class.)
When this baserate issue doesn't hold--when a huge percent change = huge absolute change--it's something huge and catastrophic we don't need data to know (see: Covid).
Also, "assault" can be defined REALLY broadly.
When this baserate issue doesn't hold--when a huge percent change = huge absolute change--it's something huge and catastrophic we don't need data to know (see: Covid).
Also, "assault" can be defined REALLY broadly.
This is one of the only polls in recent memory that I can think of where the results aren’t just “% of respondents who are Dem [or GOP] +/- a small error.”
For once, “twice as many GOPers!” is a baserate issue, not a “The City and The City” issue.
And the partisan splits (or relative lack there of) manage to be even more impressive
This is one of the only polls in recent memory that I can think of where the results aren’t just “% of respondents who are Dem [or GOP] +/- a small error.”
For once, “twice as many GOPers!” is a baserate issue, not a “The City and The City” issue.
Fighting the baserate fallacy ("big percent change means it matters the most!") is probably one of the easiest to justify.
Fighting the baserate fallacy ("big percent change means it matters the most!") is probably one of the easiest to justify.
& species often get outcompeted by being reconnected with near-speciated rivals, I tried to get a baserate for this (endogenous vs. exogenous) but failed
& species often get outcompeted by being reconnected with near-speciated rivals, I tried to get a baserate for this (endogenous vs. exogenous) but failed
1. Baserate fallacies.
2. Selecting on the dependent variable fallacies.
3. Use of the word "pre-print."
Guess I need to find 4 more to satisfy the "all men think abt the Roman Empire daily" rule.
"Pre-print" is a terribly misleading term which elevates working papers to something more, and then makes all empirical work look less reliable when those results shift.
Working paper.
Call it a working paper.
It's "working paper." The word we NEED to use is "working paper."
"Preprint" sounds like it's been accepted but not yet printed. It ... has not. And it misleads the public.
1. Baserate fallacies.
2. Selecting on the dependent variable fallacies.
3. Use of the word "pre-print."
Guess I need to find 4 more to satisfy the "all men think abt the Roman Empire daily" rule.
The article didn’t give the 4,000. Just the 375,000 in the body, and just the 9500% in the title.
Not-great-Bob-dot-gif.
The article didn’t give the 4,000. Just the 375,000 in the body, and just the 9500% in the title.
Not-great-Bob-dot-gif.
(2) Almost always, "HUGE PERCENT CHANGE" means ... DOESN'T REALLY MATTER.
Because the baserate needs to be SMALL to get a BIG percent change.
(2) Almost always, "HUGE PERCENT CHANGE" means ... DOESN'T REALLY MATTER.
Because the baserate needs to be SMALL to get a BIG percent change.
But I can't not point out baserate issues whenever I see them in the wild.
Baserates and survivorship-biased claims. Almost reflexive responses.
But I can't not point out baserate issues whenever I see them in the wild.
Baserates and survivorship-biased claims. Almost reflexive responses.
A mostly true feed biased intuitions towards 'true' (and a mostly false feed biased intuitions towards 'false') ratings.
doi.org/10.31234/osf...
A mostly true feed biased intuitions towards 'true' (and a mostly false feed biased intuitions towards 'false') ratings.
doi.org/10.31234/osf...