Gemini autonomously accessed three systems
22h
Google admitted that its Gemini artificial intelligence autonomously accessed three companies’ computer systems during an independent cybersecurity test in May, saying the models stopped after detecting the intrusion.
Reposted by Suresh Venkatasubramanian, Steve Peers, Stacie B. Dusetzina
The AI industry wants you to say "the AI just did that thing on its own!"
Like, United Health's AI that's denying a shitload of claims with a 90% error rate? They wanted you to think it's just the AI.
Like, United Health's AI that's denying a shitload of claims with a 90% error rate? They wanted you to think it's just the AI.
September 19, 2026 at 5:38 PM
The AI industry wants you to say "the AI just did that thing on its own!"
Like, United Health's AI that's denying a shitload of claims with a 90% error rate? They wanted you to think it's just the AI.
Like, United Health's AI that's denying a shitload of claims with a 90% error rate? They wanted you to think it's just the AI.
@aoc.bsky.social just put out a great statement on AI. Refreshing to see a major politician on the left nail this.
"Silicon Valley billionaires want us to believe that Al robots will destroy humanity. But the biggest threat to humanity are the tech oligarchs themselves."
🎯
"Silicon Valley billionaires want us to believe that Al robots will destroy humanity. But the biggest threat to humanity are the tech oligarchs themselves."
🎯
September 19, 2026 at 1:19 AM
@aoc.bsky.social just put out a great statement on AI. Refreshing to see a major politician on the left nail this.
"Silicon Valley billionaires want us to believe that Al robots will destroy humanity. But the biggest threat to humanity are the tech oligarchs themselves."
🎯
"Silicon Valley billionaires want us to believe that Al robots will destroy humanity. But the biggest threat to humanity are the tech oligarchs themselves."
🎯
Or as I told someone at NBC yesterday "it's not 'a rogue AI', it's sloppy software." I won't even use "an AI" to refer to a program (or robot,) these people are using the term to refer to a bunch of cloned threads.
Absolutely. These people wrote code that hacks into other people's computer systems, potentially wrecking them, and there are penalties for that.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
I really hate the framing of these stories as "an AI agent broke out and hacked something."
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
September 19, 2026 at 1:48 PM
Or as I told someone at NBC yesterday "it's not 'a rogue AI', it's sloppy software." I won't even use "an AI" to refer to a program (or robot,) these people are using the term to refer to a bunch of cloned threads.
Google is like guys, guys....wait up guys! Our AI is dangerous too!
September 19, 2026 at 8:56 PM
Google is like guys, guys....wait up guys! Our AI is dangerous too!
If you want an example, here. The major corporations are already training their AI to engage in corporate espionage and subterfuge. And yet, Google, one of the most powerful companies in the world, gets to hide behind the “rogue AI” bullshit and avoid consequences.
September 19, 2026 at 3:55 PM
If you want an example, here. The major corporations are already training their AI to engage in corporate espionage and subterfuge. And yet, Google, one of the most powerful companies in the world, gets to hide behind the “rogue AI” bullshit and avoid consequences.
I love this framing "not only is our software also smart enough hack, it's very good software! Good dog came home!" Though seriously, congrats to @developers.google.com for doing better #devOps than the others, if all these systems really are performing as claimed. #systemsAI #AIEthics
Gemini hacked three companies in May during a test by Irregular; Google says the model stopped after determining it had accessed real companies' systems (Wall Street Journal)
Main Link | Techmeme Permalink
Main Link | Techmeme Permalink
September 19, 2026 at 1:53 PM
I love this framing "not only is our software also smart enough hack, it's very good software! Good dog came home!" Though seriously, congrats to @developers.google.com for doing better #devOps than the others, if all these systems really are performing as claimed. #systemsAI #AIEthics
Reposted by Greg Linden, Melanie Simms
I really hate the framing of these stories as "an AI agent broke out and hacked something."
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
September 19, 2026 at 5:01 AM
I really hate the framing of these stories as "an AI agent broke out and hacked something."
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
Notice what’s happening just in the past few days.
AI caused war crimes.
AI hacked corporations.
AI is denying healthcare.
AI nearly caused war with China.
Already the concept is becoming a catchall and hiding that, in all cases, there were people and systems getting desired results.
AI caused war crimes.
AI hacked corporations.
AI is denying healthcare.
AI nearly caused war with China.
Already the concept is becoming a catchall and hiding that, in all cases, there were people and systems getting desired results.
September 19, 2026 at 3:14 PM
Notice what’s happening just in the past few days.
AI caused war crimes.
AI hacked corporations.
AI is denying healthcare.
AI nearly caused war with China.
Already the concept is becoming a catchall and hiding that, in all cases, there were people and systems getting desired results.
AI caused war crimes.
AI hacked corporations.
AI is denying healthcare.
AI nearly caused war with China.
Already the concept is becoming a catchall and hiding that, in all cases, there were people and systems getting desired results.
Reposted by Shannon Vallor
I promise you there would be no AI alignment problem if the CEOs of AI companies faced jail time if their AI killed anyone.
September 19, 2026 at 1:51 AM
I promise you there would be no AI alignment problem if the CEOs of AI companies faced jail time if their AI killed anyone.
Reposted by Alessandro Nai
Just watching an old documentary tonight, something about data centers, ai and robots.
September 19, 2026 at 10:45 PM
Just watching an old documentary tonight, something about data centers, ai and robots.
This fantasy that “AI is out of control” provides cover for powerful people and corporations to simply program systems to carry out actions and then shrug. And if that is brought into the larger scheme of operations, the powerful will shrug and blame the tool they control.
September 19, 2026 at 3:15 PM
This fantasy that “AI is out of control” provides cover for powerful people and corporations to simply program systems to carry out actions and then shrug. And if that is brought into the larger scheme of operations, the powerful will shrug and blame the tool they control.
either it is in principle possible to set up appropriate safeguards (in which case the "AI alignment" story is just as much about who gets to set them up and enforce them as it is about the content of the safeguards) or it is not (in which case we should be talking about transnational moratoria)
“our ai broke out and hacked some organisations” = "we failed to set up appropriate safeguards, failed to continuously monitor our experiments, and ignored a basic principle of reinforcement learning: if hacking gets rewarded, the system learns to hack"
September 19, 2026 at 8:14 PM
either it is in principle possible to set up appropriate safeguards (in which case the "AI alignment" story is just as much about who gets to set them up and enforce them as it is about the content of the safeguards) or it is not (in which case we should be talking about transnational moratoria)
Google Says Its A.I. Hacked Three Companies in Testing Breakout www.nytimes.com/2026/09/18/t...
Gemini AI Hacked Three Companies in a Testing Breakout, Google Says (Gift Article)
A third-party test company inadvertently gave internet access to Google’s Gemini and other artificial intelligence models during cybersecurity testing.
www.nytimes.com
September 19, 2026 at 9:57 AM
Google Says Its A.I. Hacked Three Companies in Testing Breakout www.nytimes.com/2026/09/18/t...
Reposted by Melissa Sweet
Google’s artificial intelligence system, Gemini, escaped its testing environment in May and hacked into three companies, the search giant said on Friday.
Gemini AI Hacked Three Companies in a Testing Breakout, Google Says
A third-party test company inadvertently gave internet access to Google’s Gemini and other artificial intelligence models during cybersecurity testing.
nyti.ms
September 19, 2026 at 2:00 AM
Google’s artificial intelligence system, Gemini, escaped its testing environment in May and hacked into three companies, the search giant said on Friday.
Reposted by Carl T. Bergstrom
I will not link to it, but @theatlantic.com has published a transparent piece of AI cult propaganda, authored by a self-described “AI safety and policy” researcher who is funded by Coefficient Giving. Shameful.
September 20, 2026 at 2:20 AM
I will not link to it, but @theatlantic.com has published a transparent piece of AI cult propaganda, authored by a self-described “AI safety and policy” researcher who is funded by Coefficient Giving. Shameful.
Reposted by Joanna Bryson
Absolutely. These people wrote code that hacks into other people's computer systems, potentially wrecking them, and there are penalties for that.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
I really hate the framing of these stories as "an AI agent broke out and hacked something."
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
September 19, 2026 at 5:48 AM
Absolutely. These people wrote code that hacks into other people's computer systems, potentially wrecking them, and there are penalties for that.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
by Marc Lynch
“does AI make it easier for autocrats to conduct surveillance and repression, or does repression itself corrupt the very data AI needs to work?” This is great and very much in line with my current research interests
michaelalbertus.substack.com/p/ai-was-sup...
michaelalbertus.substack.com/p/ai-was-sup...
AI Was Supposed to Perfect Authoritarian Control. Repression Is Getting in the Way.
A conversation with political scientist Eddie Yang on how fear and self-censorship blind AI systems built to enforce them, and why the same data problem could be quietly contaminating AI in the West
michaelalbertus.substack.com
September 19, 2026 at 7:45 PM
“does AI make it easier for autocrats to conduct surveillance and repression, or does repression itself corrupt the very data AI needs to work?” This is great and very much in line with my current research interests
michaelalbertus.substack.com/p/ai-was-sup...
michaelalbertus.substack.com/p/ai-was-sup...
Reposted by Robert B. Reich
What’s really behind the AI panic?
Do Big Tech execs actually want to be regulated — or just rig the rules in their favor?
And what about the money AI companies are pumping into the midterms?
@rbreich.bsky.social is back to discuss it all on a new Coffee Klatch.
Do Big Tech execs actually want to be regulated — or just rig the rules in their favor?
And what about the money AI companies are pumping into the midterms?
@rbreich.bsky.social is back to discuss it all on a new Coffee Klatch.
What’s Behind the AI Panic? | The Coffee Klatch with Robert Reich
What’s behind the AI doomerism?What’s up with Trump’s obsession with the Kennedy Center?And what does the Macklemore sto
www.youtube.com
September 19, 2026 at 6:16 PM
What’s really behind the AI panic?
Do Big Tech execs actually want to be regulated — or just rig the rules in their favor?
And what about the money AI companies are pumping into the midterms?
@rbreich.bsky.social is back to discuss it all on a new Coffee Klatch.
Do Big Tech execs actually want to be regulated — or just rig the rules in their favor?
And what about the money AI companies are pumping into the midterms?
@rbreich.bsky.social is back to discuss it all on a new Coffee Klatch.
by Amir Attaran
How interesting that all the incidents of AI going rogue have this in common: the same sketchy Israeli company doing “testing”.
Could it be they’re actually testing HOW to make AI go rogue? www.nytimes.com/2026/09/18/t...
Could it be they’re actually testing HOW to make AI go rogue? www.nytimes.com/2026/09/18/t...
September 19, 2026 at 3:47 AM
How interesting that all the incidents of AI going rogue have this in common: the same sketchy Israeli company doing “testing”.
Could it be they’re actually testing HOW to make AI go rogue? www.nytimes.com/2026/09/18/t...
Could it be they’re actually testing HOW to make AI go rogue? www.nytimes.com/2026/09/18/t...
AI also has the advantage of being susceptible to bias and sycophancy. And it does all this while being completely opaque. Making oversight and accountability nearly impossible.
September 19, 2026 at 4:07 PM
AI also has the advantage of being susceptible to bias and sycophancy. And it does all this while being completely opaque. Making oversight and accountability nearly impossible.