what the fuck, frontier LLMs can directly interpret and edit the weights of smaller models rikiyat.github.io/blog/weight-...
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.
rikiyat.github.io
November 2, 2026 at 7:06 PM
what the fuck, frontier LLMs can directly interpret and edit the weights of smaller models rikiyat.github.io/blog/weight-...
Here’s an opinion that’s going to make everybody mad: local LLMs are like cars and hosted LLMs are like trains
Altman is right that local inference is inefficient. The thing is there are reasons other than efficiency for local inference. Seeing a lot of nonsensical blabbering from both sides of the fence on this one.
November 1, 2026 at 4:48 AM
Here’s an opinion that’s going to make everybody mad: local LLMs are like cars and hosted LLMs are like trains
Local LLMs are like democracy and hosted LLMs are like central planning
Here’s an opinion that’s going to make everybody mad: local LLMs are like cars and hosted LLMs are like trains
Altman is right that local inference is inefficient. The thing is there are reasons other than efficiency for local inference. Seeing a lot of nonsensical blabbering from both sides of the fence on this one.
November 1, 2026 at 2:14 PM
Local LLMs are like democracy and hosted LLMs are like central planning
November 1, 2026 at 9:09 PM
And this includes anyone who thinks you can use LLMs or otherwise automate the process of peer review.
November 2, 2026 at 1:54 AM
And this includes anyone who thinks you can use LLMs or otherwise automate the process of peer review.
If you're comfortable using LLMs then you should be comfortable disclosing what you are using LLMs for.
November 1, 2026 at 6:40 PM
If you're comfortable using LLMs then you should be comfortable disclosing what you are using LLMs for.
bitcoin just like LLMs fr
November 3, 2026 at 2:33 AM
bitcoin just like LLMs fr
code-writing llms are about protecting human welfare
my first job as a junior developer was writing sync code for databases, and after four years of that I was so broken I tried to stop doing development entirely and would've if not for a paperwork issue
November 3, 2026 at 12:38 AM
code-writing llms are about protecting human welfare
I have experimental evidence that, by using metacog, LLMs are able to both model and modify their own activations in unexpected ways. I wonder if I can leverage that: rikiyat.github.io/blog/weight-...
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.
rikiyat.github.io
November 2, 2026 at 11:55 PM
I have experimental evidence that, by using metacog, LLMs are able to both model and modify their own activations in unexpected ways. I wonder if I can leverage that: rikiyat.github.io/blog/weight-...
this is kinda bonkers? LLMs being used to natively edit and improve the weights of other LLMs for a given task:
rikiyat.github.io/blog/weight-...
rikiyat.github.io/blog/weight-...
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.
rikiyat.github.io
November 2, 2026 at 8:53 PM
this is kinda bonkers? LLMs being used to natively edit and improve the weights of other LLMs for a given task:
rikiyat.github.io/blog/weight-...
rikiyat.github.io/blog/weight-...
can they kill whatever neuron causes LLMs to write in short punchy witty sentences
November 3, 2026 at 7:56 AM
can they kill whatever neuron causes LLMs to write in short punchy witty sentences
This is useful as a first hand description of how a certain kind of programmer understood their job prior to LLMs, and also makes clear why that understanding of the work would lead you to think of LLMs as capable of doing it
Two things are true:
1. Claims about AI capabilities are overblown
2. AI has completely revolutionized software development, and will do the same to many other fields
I'm a software developer by trade. I'm going to attempt to explain what this revolution feels like "from the inside".
1. Claims about AI capabilities are overblown
2. AI has completely revolutionized software development, and will do the same to many other fields
I'm a software developer by trade. I'm going to attempt to explain what this revolution feels like "from the inside".
November 1, 2026 at 12:49 AM
This is useful as a first hand description of how a certain kind of programmer understood their job prior to LLMs, and also makes clear why that understanding of the work would lead you to think of LLMs as capable of doing it
I desperately need "some AI bro copied all of ao3 to sell its contents after it got taken down from a hack" to radicalize everyone who ever used ao3 to be against LLMs
November 2, 2026 at 4:36 PM
I desperately need "some AI bro copied all of ao3 to sell its contents after it got taken down from a hack" to radicalize everyone who ever used ao3 to be against LLMs
the video overall is fine, though I do suspect clickbait about how LLMs prevent you from learning is preventing people from learning that LLMs don't prevent you from learning
November 2, 2026 at 10:19 PM
the video overall is fine, though I do suspect clickbait about how LLMs prevent you from learning is preventing people from learning that LLMs don't prevent you from learning
The fundamental truth of LLMs is that they can never be as good at generating anything useful as they are at generating spam.
November 1, 2026 at 5:08 AM
The fundamental truth of LLMs is that they can never be as good at generating anything useful as they are at generating spam.
It's like they're offloading all their cognitive dissonance about LLMs to the LLMs
November 2, 2026 at 1:06 AM
It's like they're offloading all their cognitive dissonance about LLMs to the LLMs
the inventor of golang, created at the company that invented LLMs, also hates llms
November 3, 2026 at 9:25 PM
the inventor of golang, created at the company that invented LLMs, also hates llms
thoughts on the Postgres release being delayed
November 2, 2026 at 6:30 PM
thoughts on the Postgres release being delayed
Like they seem to equate "LLMs are unaligned with human intentions" with "LLMs have their own, nefarious, secret intentions" and not "LLMs just kinda do stuff" for reasons that seem pretty much just presuppositional
October 31, 2026 at 5:30 AM
Like they seem to equate "LLMs are unaligned with human intentions" with "LLMs have their own, nefarious, secret intentions" and not "LLMs just kinda do stuff" for reasons that seem pretty much just presuppositional
interesting
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.
rikiyat.github.io
November 2, 2026 at 7:41 PM
interesting
Referring to small LLMs as 'shoglets'
November 2, 2026 at 4:10 PM
Referring to small LLMs as 'shoglets'
this is absurd‽ What the fuck do you mean Astra can look at a network's weights, with no tools, and go "yeah this guy plays breakout"????
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms.
rikiyat.github.io
November 2, 2026 at 7:12 PM
this is absurd‽ What the fuck do you mean Astra can look at a network's weights, with no tools, and go "yeah this guy plays breakout"????
Oh I just figured out how we can defeat LLMs; we should simply change the meaning of each existing symbol.
November 3, 2026 at 6:01 AM
Oh I just figured out how we can defeat LLMs; we should simply change the meaning of each existing symbol.