#mTurk
yep. everyone wants to be a data scientist, no one wants to be descend into the subterranean piss reeking corridors of the survey scientist, uh oh wait there is no more data & no one under 50 answers the phone anymore & mturk is gone & high quality respondents are $50 each now how did that happen
I think part of this is survey methods are wildly neglected and frankly looked down upon in PhD programs. Running a good survey is hard work and takes time you could be spending writing papers based on someone else’s survey. Now we don’t have anyone running surveys. Whoops.
November 14, 2026 at 5:39 AM
📦 All data is open (CC BY 4.0), with humans, VLMs and models on the same trials:

• 240 human MTurk sessions (12 tasks × 20)
• 960 trials over 100 HvM images
• 4 VLMs × 6 runs
• 564 checkpoints (94 models × 6 seeds)
• Cached evals, no GPU needed

🤗 huggingface.co/datasets/rdh1115/pixels-over-symbols
rdh1115/pixels-over-symbols · Datasets at Hugging Face
Dataset. Explore, preview and download it on Hugging Face.
huggingface.co
November 16, 2026 at 10:15 PM
Amazon mturk closed as soon as i signed up and made $7 lol
Honeygain sells your data but worth it doesnt drain too much battery
Coinout sweatcoin fetch
November 13, 2026 at 11:13 PM
“Understanding perception is critical to effective visualization design.”
#Heer and #Bostock
https://www.cs.kent.edu/~javed/class-P2P12F/papers-2012/PAPER2012-2010-MTurk-CHI.pdf
November 4, 2026 at 3:14 PM
I'll be honest, I was surprised by the results.

Of the 8 questions, on average, people correctly identified ~5-6. But this knowledge had cleavages by birth cohort, race/ethnicity, religion, and more!
October 30, 2026 at 2:40 PM
MTurk closed down a few weeks ago, and I haven't seen much discussion on it at all in the community. AI can not only solve most attention checks well, but modern tools (rarely implemented in the first place) fail more and more.

Collecting real data online is becoming more and more difficult.
October 26, 2026 at 6:22 PM
None of those problems are unique to online experiments as your abstract says. Did you actually discover problems with online studies in particular. (Also, to be honest ... MTurk?)
October 24, 2026 at 11:01 AM
Oh nah, that was back in 2020, they used a service called Amazon MTurk to sample. it was bad and did very weird things

MTurk + Emerson

and folks got so caught up in assuming they only got goofy results that yeah, some forgot that it is ordinarily a normal pollster when it doesn't hedge red waves
October 22, 2026 at 6:40 PM
In 2020 they used Amazon MTurk for sampling and it was widely mocked for causing weird results

I think some people forgot this years ago, that it was MTurk + Emerson and just apply it now whenever they think something is weird

Anyway it's R+11.5 sample, red wave junk like the other polls sigh
October 22, 2026 at 3:15 PM
Mturk couldn't make this tho
October 21, 2026 at 3:08 AM
Amazon's Mechanical Turk (MTurk) closed down on September 30th. I just learned this tonight! MTurk has had data quality issues for years, and the emergence and omnipresence of AI only made these issues worse. However, I did not realize it was gone forever!
October 21, 2026 at 2:50 AM
the relative lack of discussion about it still surprised me, but it's probably also a case of "we all know MTurk has been shit for years and nobody really uses it for research any more"
October 21, 2026 at 3:00 AM
"It’s our talent and our labor that’s fueled the current gains in AI... and because we made it, we have the power to change it."

Krista Pawlowski from @turkopticon.bsky.social reminds us how organized workers can shape the future of tech.
inthesetimes.com/article/amaz...
What the End of Amazon’s MTurk Tells Us About Today’s AI Race
Human labor fueled the rise of AI. It can also be used to halt it.
inthesetimes.com
October 19, 2026 at 9:04 PM
It’s definitely a values question but I’m way more impressed by people who consistently produce bangers even if it’s only once a year or so than folks who just convert grant funding into mturk participants.
October 17, 2026 at 11:36 PM
What the End of Amazon’s MTurk Tells Us About Today’s AI Race inthesetimes.com/article/amaz...
What the End of Amazon’s MTurk Tells Us About Today’s AI Race
Human labor fueled the rise of AI. It can also be used to halt it.
inthesetimes.com
October 17, 2026 at 11:06 AM
What the End of Amazon’s MTurk Tells Us About Today’s AI Race - In These Times inthesetimes.com/article/amaz...
October 17, 2026 at 2:12 AM
My spouse used to do Amazon mturk and it was not good for a primary income but it was at least always available so good for "I've got nothing better to do right now"
October 16, 2026 at 2:26 PM
For context, Prolific is generally a high quality sample.

(It's basically a MTurk clone designed around the needs of academic researchers. The population is validated and I think they get kicked out if they do too many shenanigans.)
October 9, 2026 at 10:37 PM
MTurk may be gone, but many requesters and the work they offer haven’t disappeared. We’ll continue sharing where workers can find familiar requesters and new opportunities.
October 8, 2026 at 2:11 AM
Sure, managing the administrative work attached to it. Definitely, AI is helpful. But recruiting and making sure you have real people is harder. This seems obvious to me. MTurk is gone. Every other online platform is in an arms race with verification procedures.
October 8, 2026 at 12:18 AM
I'm not sure this back-and-forth is very productive. On my end, your claims seem like mere assertions as well. I'll try with this: MTurk is shut down, and all online survey research firms have had to implement much more costly respondent-verification protocols. Those are real-world things happening.
October 8, 2026 at 12:59 AM
omg amazon killed mturk? damn i knew people on the margins who could survive on turking and now AI is taking the job of the lumpenprole
October 7, 2026 at 1:39 AM
Hi @awscloud.bsky.social. I reached out via X.com for customer service request, but X's AI misinterpreted tweet. Now, I'm among millions suspended for doing nothing wrong. I can't read the reply. Who can I contact about MTurk payment issue? I'm having zero success w/ the Contact Us form. TY.
October 6, 2026 at 2:33 AM
It makes sense because that's likely the bulk of the training materials they pulled from. Similar to how online AI articles are heavily influenced by paper mill writing from mturk writers churning out cookie cutter articles for over a decade.
October 4, 2026 at 10:15 PM