Removing the model’s built-in refusal mechanism, allowing it to respond to all types of prompts.
“Abliteration” can uncensor any LLM without retraining
Removing the model’s built-in refusal mechanism, allowing it to respond to all types of prompts.
“Abliteration” can uncensor any LLM without retraining
Something like taking a clever inner product v + w and v - w and using non-negativity
But I can't find it. The only proofs I saw used uglier tricks like orthogonalisation or taking the discriminant of a polynomial
Something like taking a clever inner product v + w and v - w and using non-negativity
But I can't find it. The only proofs I saw used uglier tricks like orthogonalisation or taking the discriminant of a polynomial
Still I have some vague memory of it being possible without the polynomial or without the orthogonalisation, but it's possible I'm confusing it with a different inequality
Still I have some vague memory of it being possible without the polynomial or without the orthogonalisation, but it's possible I'm confusing it with a different inequality
||v||^2 ||w||^2 = ||v||^2 * (||u||^2 + ||z||^2) > |a|^2*||v||^4 = |a|^2*|<v,v>|^2 = |<v,u>|^2
*we can guarantee this by choosing u = <v,w>/<v,v> * v and z = w - u
||v||^2 ||w||^2 = ||v||^2 * (||u||^2 + ||z||^2) > |a|^2*||v||^4 = |a|^2*|<v,v>|^2 = |<v,u>|^2
*we can guarantee this by choosing u = <v,w>/<v,v> * v and z = w - u
https://arxiv.org/abs/2601.18801
https://arxiv.org/abs/2601.18801
Abstract: In 1976, L.N. Vaserstein used a construction analogous to the Gram-Schmidt orthogonalisation, for obtaining a set of symplectic matrices from a set of elementary matrices. We have a similar construction [1/2 of https://arxiv.org/abs/2505.16295v1]
Abstract: In 1976, L.N. Vaserstein used a construction analogous to the Gram-Schmidt orthogonalisation, for obtaining a set of symplectic matrices from a set of elementary matrices. We have a similar construction [1/2 of https://arxiv.org/abs/2505.16295v1]
https://arxiv.org/pdf/2603.02966
Matisse Wei-Yuan Tu, Angel Rubio, E.K.U. Gross.
https://arxiv.org/pdf/2603.02966
Matisse Wei-Yuan Tu, Angel Rubio, E.K.U. Gross.
Le cerveau américain ne peut pas comprendre.
#Orthogonalisation
#Amsterdam
#Amstertram
Le cerveau américain ne peut pas comprendre.
#Orthogonalisation
#Amsterdam
#Amstertram