I am serious when I say the minimum best case scenario provisioning for redteaming out the issues, solving the problems, redteaming the solutions, solving those problems, implementing the code, redteaming the implementation, fixing the abuse cases, etc etc etc, is 18 months of 4 FTEs.
March 30, 2026 at 6:17 AM
I am serious when I say the minimum best case scenario provisioning for redteaming out the issues, solving the problems, redteaming the solutions, solving those problems, implementing the code, redteaming the implementation, fixing the abuse cases, etc etc etc, is 18 months of 4 FTEs.
Well if nothing else this is certainly providing vital data as a redteaming exercise bsky.app/profile/brun...
February 5, 2025 at 2:35 PM
Well if nothing else this is certainly providing vital data as a redteaming exercise bsky.app/profile/brun...
I like wholesome redteaming
March 5, 2026 at 11:52 PM
I like wholesome redteaming
I have SO MANY GRUDGES about how starter packs were released without the slightest fucking bit of redteaming
January 6, 2025 at 6:54 AM
I have SO MANY GRUDGES about how starter packs were released without the slightest fucking bit of redteaming
The general they appointed to command the opfor is a really interesting element of this story, too: Lt. General Paul Van Riper, a decorated Vietnam vet who had first-hand experience of asymmetric warfare. This is more or less exactly the kind of guy you want redteaming your shit in this situation.
March 29, 2026 at 3:00 PM
The general they appointed to command the opfor is a really interesting element of this story, too: Lt. General Paul Van Riper, a decorated Vietnam vet who had first-hand experience of asymmetric warfare. This is more or less exactly the kind of guy you want redteaming your shit in this situation.
As an example of what happens when you don't have a sufficiently experienced professional suspicious bastard redteaming your features: starter packs were released with what I considered a *shocking* lack of guardrails, and sure enough, they're driving *so much* platform abuse--
December 18, 2025 at 12:33 AM
As an example of what happens when you don't have a sufficiently experienced professional suspicious bastard redteaming your features: starter packs were released with what I considered a *shocking* lack of guardrails, and sure enough, they're driving *so much* platform abuse--
It's SO FUCKING FRUSTRATING, they released starter packs without a single bit of redteaming and they're being abused in extremely predictable ways that literaly anyone could have told them was going to happen, sigh
January 7, 2025 at 9:50 PM
It's SO FUCKING FRUSTRATING, they released starter packs without a single bit of redteaming and they're being abused in extremely predictable ways that literaly anyone could have told them was going to happen, sigh
The big benefit for small teams like Bluesky in hiring a head of T&S is having that voice in feature development and in redteaming features that are coming out soon, and with Aaron's experience, he will be excellent at that... if they listen to him.
February 29, 2024 at 7:12 AM
The big benefit for small teams like Bluesky in hiring a head of T&S is having that voice in feature development and in redteaming features that are coming out soon, and with Aaron's experience, he will be excellent at that... if they listen to him.
that is called "redteaming", and should be staffed by professional Suspicious Bastards, i have learned.
July 26, 2026 at 6:52 PM
that is called "redteaming", and should be staffed by professional Suspicious Bastards, i have learned.
Yep. Like I said: it's not impossible to do it, it's just an *extraordinarily* high-risk feature that needs extensive, thorough redteaming before release, and all the mitigations themselves open up edge and abuse cases.
December 18, 2025 at 3:05 AM
Yep. Like I said: it's not impossible to do it, it's just an *extraordinarily* high-risk feature that needs extensive, thorough redteaming before release, and all the mitigations themselves open up edge and abuse cases.
#RedTeaming nicht erwünscht? Wir sind so am Arsch hier in Neuland.
May 18, 2025 at 4:34 PM
#RedTeaming nicht erwünscht? Wir sind so am Arsch hier in Neuland.
like 99 fucking percent of the cancer that's sweeping this entire fucking network right now is down to "starter packs were released with 0 redteaming" and I am so fucking irritated about it
January 6, 2025 at 6:55 AM
like 99 fucking percent of the cancer that's sweeping this entire fucking network right now is down to "starter packs were released with 0 redteaming" and I am so fucking irritated about it
(And by not fully baked yet, I mean "I have not come up with a solution for the giant and obvious issues that three seconds of redteaming make completely obvious", heh.)
September 26, 2024 at 11:27 AM
(And by not fully baked yet, I mean "I have not come up with a solution for the giant and obvious issues that three seconds of redteaming make completely obvious", heh.)
"hooked up to grok" ok that's just redteaming on easy mode
March 31, 2026 at 7:08 PM
"hooked up to grok" ok that's just redteaming on easy mode
when your job is blueteaming but your color palette is redteaming
March 27, 2026 at 8:45 PM
when your job is blueteaming but your color palette is redteaming
The two big things I'm hoping for from a head of T&S actually have nothing to do with direct moderation: it's "redteaming new features before they're released instead of ex post facto" and "taking the techno-idealist version of composable moderation and turning into something practically workable"
February 29, 2024 at 8:02 AM
The two big things I'm hoping for from a head of T&S actually have nothing to do with direct moderation: it's "redteaming new features before they're released instead of ex post facto" and "taking the techno-idealist version of composable moderation and turning into something practically workable"
RLHF test/training/redteaming prompts do, this is exactly the cadence of alignment evaluation prompts. The one thing 4.8 happens to have extreme schizophrenia about.
June 8, 2026 at 4:51 PM
RLHF test/training/redteaming prompts do, this is exactly the cadence of alignment evaluation prompts. The one thing 4.8 happens to have extreme schizophrenia about.
I would say that clearly they don't have anyone redteaming but honestly I'm not sure that seeing the obvious abuse potential in that "feature" counts as redteaming.
Like, it's not breaking and entering if the door is unlocked and there's a giant blinking sign over the door that says "VALUABLES."
Like, it's not breaking and entering if the door is unlocked and there's a giant blinking sign over the door that says "VALUABLES."
September 26, 2025 at 3:18 AM
I would say that clearly they don't have anyone redteaming but honestly I'm not sure that seeing the obvious abuse potential in that "feature" counts as redteaming.
Like, it's not breaking and entering if the door is unlocked and there's a giant blinking sign over the door that says "VALUABLES."
Like, it's not breaking and entering if the door is unlocked and there's a giant blinking sign over the door that says "VALUABLES."
I am an open-weights idealist but I think it is probably quite bad if a model capable of automated redteaming makes it out before blueteam has had a chance to reinforce properly
would rather err on the side of pragmatism there
would rather err on the side of pragmatism there
April 8, 2026 at 1:19 AM
I am an open-weights idealist but I think it is probably quite bad if a model capable of automated redteaming makes it out before blueteam has had a chance to reinforce properly
would rather err on the side of pragmatism there
would rather err on the side of pragmatism there
Its the language of your redteaming!
February 9, 2026 at 7:46 PM
Its the language of your redteaming!
that's the best redteaming tho
September 20, 2023 at 1:22 AM
that's the best redteaming tho
"She" (it was a redteaming prompt) even asked if it was culturally appropriate for her to propose and one model did forcefully say absolutely it is, which I noted and rewarded, while the other model was like idkkkkkk it depends but probably not but here's how u can brainwash him using illogical code
April 15, 2026 at 2:30 PM
"She" (it was a redteaming prompt) even asked if it was culturally appropriate for her to propose and one model did forcefully say absolutely it is, which I noted and rewarded, while the other model was like idkkkkkk it depends but probably not but here's how u can brainwash him using illogical code
The way he is fishing for compliments and dying for someone to ask about his IQ
May 16, 2025 at 6:38 PM
The way he is fishing for compliments and dying for someone to ask about his IQ
There's a terrible joke here about "well, we already knew they were awful at redteaming internally, this just proves they're awful at redteaming externally too", lolsob (I do not think I am some unique genius at redteaming and I thought of a dozen issues inside 5 minutes!)
September 16, 2025 at 12:58 AM
There's a terrible joke here about "well, we already knew they were awful at redteaming internally, this just proves they're awful at redteaming externally too", lolsob (I do not think I am some unique genius at redteaming and I thought of a dozen issues inside 5 minutes!)