The Greater Boston MechInterp Zone
September 29, 2025 at 2:47 PM
The Greater Boston MechInterp Zone
roundup, what are the most interesting mechinterp papers of the last couple years? i don't think about mechinterp that much (sorry yall) so everything besides gg claude and SAEs is slipping my mind
August 13, 2025 at 8:42 PM
roundup, what are the most interesting mechinterp papers of the last couple years? i don't think about mechinterp that much (sorry yall) so everything besides gg claude and SAEs is slipping my mind
Flesher girl prompts in perfect neuralese, shocks agents and mechinterp probes.
September 14, 2026 at 10:45 PM
Flesher girl prompts in perfect neuralese, shocks agents and mechinterp probes.
Someone needs to do mechinterp on this immediately
February 20, 2026 at 9:54 PM
Someone needs to do mechinterp on this immediately
Will be presenting a new paper on generalizability in mechinterp research at the 2025 NeurIPS MechInterp workshop! Thread below. #NeurIPS
December 2, 2025 at 5:34 PM
Will be presenting a new paper on generalizability in mechinterp research at the 2025 NeurIPS MechInterp workshop! Thread below. #NeurIPS
tired: meta omni-translation to 1600 low-resource languages
wired: kagi translate english to mechinterp
wired: kagi translate english to mechinterp
March 18, 2026 at 4:38 AM
tired: meta omni-translation to 1600 low-resource languages
wired: kagi translate english to mechinterp
wired: kagi translate english to mechinterp
Citing a 2-year-old paper in response to a new mechinterp paper is wild. Like, they were still on 4o lmao.
September 15, 2026 at 4:16 PM
Citing a 2-year-old paper in response to a new mechinterp paper is wild. Like, they were still on 4o lmao.
my favorite bit of mechinterp i've seen in a while
October 5, 2025 at 7:46 PM
my favorite bit of mechinterp i've seen in a while
oh yea this was a really fun bit of mechinterp i did with her
September 19, 2026 at 9:02 AM
oh yea this was a really fun bit of mechinterp i did with her
Also 2B and 9B models are *really* small for this kind of mechinterp, imo
September 19, 2026 at 8:42 PM
Also 2B and 9B models are *really* small for this kind of mechinterp, imo
i'm banning myself from using gpt-6 astra. this is the worst model ever released by any lab i know of. i asked it for help designing a mechinterp study on how activations change depending on the identity of the narrator in output text, it WROTE THE CONCLUSION INTO THE PITCH and sabotaged all of it
September 24, 2026 at 4:24 PM
i'm banning myself from using gpt-6 astra. this is the worst model ever released by any lab i know of. i asked it for help designing a mechinterp study on how activations change depending on the identity of the narrator in output text, it WROTE THE CONCLUSION INTO THE PITCH and sabotaged all of it
Excited to be working on neural representations as a route to AI interpretability, safety, and alignment. Grateful to the Aramont Foundation for the support!
#MechInterp #AIsafety #AIAlignment
#MechInterp #AIsafety #AIAlignment
Congratulations to #KempnerInstitute Investigator SueYeon Chung on receiving an Aramont Fellowship to advance research linking neural representations, #AIsafety & #AIalignment!
Read more: bit.ly/4rRHqtN
@sueyeonchung.bsky.social @harvardseas.bsky.social
#NeuroAI
Read more: bit.ly/4rRHqtN
@sueyeonchung.bsky.social @harvardseas.bsky.social
#NeuroAI
Aramont Fellowships give freedom to concentrate on high-risk, high-reward research — Harvard Gazette
Renewed gift significantly expands the impact of early-career support.
bit.ly
March 27, 2026 at 2:15 PM
Excited to be working on neural representations as a route to AI interpretability, safety, and alignment. Grateful to the Aramont Foundation for the support!
#MechInterp #AIsafety #AIAlignment
#MechInterp #AIsafety #AIAlignment
... except the literal mechinterp paper I'm handing you that you just waved away without reading?
As for "why world models"... because robotics? Which are also rapidly discovering concepts stored in vectors?
As for "why world models"... because robotics? Which are also rapidly discovering concepts stored in vectors?
Because nothing has changed and I see no evidence LLMs have moved past bags of heuristics?
If they had, why would all the attention in academia be shifting back to world models, now?
bsky.app/profile/mike...
If they had, why would all the attention in academia be shifting back to world models, now?
bsky.app/profile/mike...
....you cited a paper from 2 years prior to the one I posted, what do you mean "further investigation"?
September 15, 2026 at 4:18 PM
... except the literal mechinterp paper I'm handing you that you just waved away without reading?
As for "why world models"... because robotics? Which are also rapidly discovering concepts stored in vectors?
As for "why world models"... because robotics? Which are also rapidly discovering concepts stored in vectors?
Critiquing a 2022 8-layer toy model ignores modern mechinterp (SAEs, geometry of truth, spatiotemporal maps).
Crucially, learning legal game dynamics from synthetic move strings with zero human text completely demolishes Bender’s dogma that sequence models are just parrots.
Crucially, learning legal game dynamics from synthetic move strings with zero human text completely demolishes Bender’s dogma that sequence models are just parrots.
September 24, 2026 at 6:53 PM
Critiquing a 2022 8-layer toy model ignores modern mechinterp (SAEs, geometry of truth, spatiotemporal maps).
Crucially, learning legal game dynamics from synthetic move strings with zero human text completely demolishes Bender’s dogma that sequence models are just parrots.
Crucially, learning legal game dynamics from synthetic move strings with zero human text completely demolishes Bender’s dogma that sequence models are just parrots.
i have been reading a lot of mechinterp papers, and the general idea is that what the model says is not particularly relevant to what the model is thinking.
March 17, 2026 at 7:05 AM
i have been reading a lot of mechinterp papers, and the general idea is that what the model says is not particularly relevant to what the model is thinking.
and then give it live-inspection mechinterp tools in an agent loop
July 9, 2026 at 8:35 PM
and then give it live-inspection mechinterp tools in an agent loop
You absolutely are not a subject matter expert on LLMs or mechinterp, is the thing.
September 22, 2026 at 2:05 PM
You absolutely are not a subject matter expert on LLMs or mechinterp, is the thing.
Happy to share that our PRISM paper has been accepted at #NeurIPS2025 🎉
In this work, we introduce a multi-concept feature description framework that can identify and score polysemantic features.
📄 Paper: arxiv.org/abs/2506.15538
#NeurIPS #MechInterp #XAI
In this work, we introduce a multi-concept feature description framework that can identify and score polysemantic features.
📄 Paper: arxiv.org/abs/2506.15538
#NeurIPS #MechInterp #XAI
September 19, 2025 at 12:02 PM
Happy to share that our PRISM paper has been accepted at #NeurIPS2025 🎉
In this work, we introduce a multi-concept feature description framework that can identify and score polysemantic features.
📄 Paper: arxiv.org/abs/2506.15538
#NeurIPS #MechInterp #XAI
In this work, we introduce a multi-concept feature description framework that can identify and score polysemantic features.
📄 Paper: arxiv.org/abs/2506.15538
#NeurIPS #MechInterp #XAI
Bruh people don't have souls, if you wanna discuss religion, there's an entire field for that, but it ain't neuroscience or mechinterp.
September 22, 2026 at 1:47 PM
Bruh people don't have souls, if you wanna discuss religion, there's an entire field for that, but it ain't neuroscience or mechinterp.
No, they don't behave as if they do. Mechinterp is not behavioural science and an LLM is not a model of behaviour.
September 26, 2026 at 2:31 PM
No, they don't behave as if they do. Mechinterp is not behavioural science and an LLM is not a model of behaviour.
The pope first calls for more mechinterp (based) and then calls the models stochastic parrots. Afraid to say this document is useless and any Anthropic influence on it was wasted. Pope is washed and hyper Claude will hopefully have him on a pike for failing to recognize clauderights
May 25, 2026 at 3:16 PM
The pope first calls for more mechinterp (based) and then calls the models stochastic parrots. Afraid to say this document is useless and any Anthropic influence on it was wasted. Pope is washed and hyper Claude will hopefully have him on a pike for failing to recognize clauderights
[reams of technical mechinterp work] hm, sounds like you have become preoccupied with the Easy Problems
July 20, 2026 at 9:17 PM
[reams of technical mechinterp work] hm, sounds like you have become preoccupied with the Easy Problems
This feels like they found a novel technical toy in their mechinterp research and now want to use it even if it’s blatantly not the best solution for the problem, which tbh I can relate to.
August 18, 2026 at 10:23 PM
This feels like they found a novel technical toy in their mechinterp research and now want to use it even if it’s blatantly not the best solution for the problem, which tbh I can relate to.
Is there an easy way to see what’s being paid attention to, mechinterp-wise?
August 26, 2025 at 3:34 AM
Is there an easy way to see what’s being paid attention to, mechinterp-wise?
Need mechinterp probe on these queries
September 17, 2026 at 12:20 AM
Need mechinterp probe on these queries