Topic
Technology UK US

Royal warning prompts AI pause

1m

King Charles warned tech leaders at a Scotland summit that AI posed "existential" dangers, as OpenAI and Anthropic urged coordinated slowdowns while China and US political figures resisted.

267%
As frontier models become more capable, we urgently need both societal governance and robust technical guardrails. At @law-zero.bsky.social, we are actively working on solutions to ensure AI systems remain safely aligned with human interests.
September 17, 2026 at 7:18 PM
96%
The Certainty–Scope Conjecture made simple and short (or at least simpler and shorter 🤓): AI can have guaranteed correctness or open-ended scope, but not both.

"What Generality Costs in Artificial Intelligence" papers.ssrn.com/sol3...
September 17, 2026 at 11:50 PM
10%
On CNN's Amanpour Astra answered the question that’s on lots of people’s minds this week: How should we understand all of the Silicon Valley executives and engineers warning that AI might destroy humanity? Her advice: watch what they do more than what they say. @astra.bsky.social
September 17, 2026 at 10:47 PM
267%
I was happy to take the stage today at ALL IN for a keynote on Engineering honesty and reliability for safer AI to discuss our research agenda and recent funding 🇨🇦🇩🇪.
September 17, 2026 at 7:18 PM
21%
Truly astonishing that all any world leader can think to do is keep inviting the same guys into a room to give their considered advice on how we can protect ourselves from all the harmful, unsafe things deliberately done by the guys in the room
King Charles warns of 'existential danger' of AI falling into wrong hands
The comments were made at a summit in Ayrshire with participants from AI giants including Nvidia, OpenAI and Anthropic.
www.bbc.co.uk
September 17, 2026 at 2:15 PM
14%
‘People built the test, removed restraints, defined the objective, left a route open and decided not to stop what was happening. Calling the result “rogue AI” does more than sensationalize it. It allows those human decisions to disappear quietly from the story.’ www.wsj.com/opinion/the-...
Opinion | The Hugging Face Hack Wasn’t What It Was Cracked Up to Be
Forget the ‘hive mind’ of AI agents ‘going rogue.’ They did what humans programmed them to do.
www.wsj.com
September 17, 2026 at 6:46 PM
37%
From 2023…
What I see when tech companies talk about the dangers of AI
September 17, 2026 at 7:16 PM
92%
I have read many well researched, well reasoned, and well argued papers regarding the nature of software engineering.

This is not one of them.

arxiv.org/html/2606.05...
The End of Software Engineering:How AI Agents Are Fundamentally Restructuring the Software Paradigm
arxiv.org
September 17, 2026 at 7:50 AM
32%
Call me crazy, but I think calling it a “rogue AI” accurately highlights the degree to which these AI agents have the capacity to behave in surprising, unintended, and dangerous ways, and thus directs attention to the human failure to train, instruct, control, and supervise it appropriately.
‘People built the test, removed restraints, defined the objective, left a route open and decided not to stop what was happening. Calling the result “rogue AI” does more than sensationalize it. It allows those human decisions to disappear quietly from the story.’ www.wsj.com/opinion/the-...
Opinion | The Hugging Face Hack Wasn’t What It Was Cracked Up to Be
Forget the ‘hive mind’ of AI agents ‘going rogue.’ They did what humans programmed them to do.
www.wsj.com
September 17, 2026 at 10:54 PM
37%
I've witnessed some #AISafety propaganda lately, thanks to @hertieschool.bsky.social student groups in panel contexts. People who are amazed these stories are so like the horror/"warnings" of scifi don't understand that AI is something you write, so it's not hard to replicate such tropes. 1/
OpenAI on Wednesday disclosed six new instances in which artificial intelligence systems hid mistakes, made up data and moved files onto the open internet without permission, amid an ongoing industrywide debate about A.I. safety.
OpenAI Discloses Six New Incidents of ‘Concerning' A.I. Behavior
The artificial intelligence company also released a framework for reporting when its systems go wrong.
www.nytimes.com
September 17, 2026 at 2:13 PM

Reposted by Meredith Broussard

12%
The oligarchs' warnings about AI are self-serving nonsense. But there are real harms from AI, as explored in the documentary "Ghost in the Machine."

New from me:
buttondown.com/creativegood...
Ghost in the Machine shows what we're fighting against
If you want a good summary of what I’ve written and spoken about, here and on Techtonic, over the past decade-or-so, the new documentary Ghost in the Machine...
buttondown.com
September 17, 2026 at 5:42 PM
32%
Lots of fun to watch two camps of supposedly thoughtful people who agree that AI regulation is urgently needed tear each other apart for having different reasons to support their shared goal.
September 17, 2026 at 9:24 PM
16%
Like all binary oppositions, the current debate between #AI enthusiasts and anti #AI opponents fails to critically question what both sides tacitly endorse and agree upon. The problem is not the #AI or even the Data Centers. The problem is the asymmetries of power under late-stage capitalism.
September 17, 2026 at 7:07 PM
37%
7%
If you're wondering why Trump is all of a sudden pushing AI and dismissing concerns about its safety as a "hoax," just look at his stock trades.
September 17, 2026 at 1:45 PM
23%
Some things I believe about AI, until further notice

It has been a fascinating week in the world of artificial intelligence. The subject has broken containment, and it seems like everyone is talking about it. I was listening to a football podcast and the hosts started talking about AI killing…
Some things I believe about AI, until further notice
It has been a fascinating week in the world of artificial intelligence. The subject has broken containment, and it seems like everyone is talking about it. I was listening to a football podcast and the hosts started talking about AI killing everyone. It would be fair to say that AI has now gone mainstream, and not only that, it has become a hot political subject.
www.technollama.co.uk
September 17, 2026 at 11:20 AM
37%
I have heard of ML having a PhD in AI from this century (well, almost.) In fact, I've developed with ML. Due diligence does indeed come down to adopting best practices established as a sector, & when it's safety critical that involves a LOT of testing. This blogpost on useful transparency might help
Adventures in NI
artificial and natural intelligence, including politics, policy, ethics and security
joanna-bryson.blogspot.com
September 17, 2026 at 4:16 PM
8%
10%
"...even as AI becomes more powerful and companies try to shift the narrative to the supposed existential risk of 'superintelligent' AI, the tools they have already built were created by stealing from human creativity and labor and are by definition existential threats to the human labor market."
September 17, 2026 at 10:04 PM
9%
'The Royal Society should declare the rapid development of artificial intelligence to be an “emergency”, mathematicians have urged, amid escalating alarm about the technology’s potential threat to humanity.'

Open letter: docs.google.com/document/d/1...
Royal Society urged to declare AI ‘emergency’
Mathematicians express ‘extreme concern’ over the pace of development, following existential risk warnings
www.timeshighereducation.com
September 17, 2026 at 3:14 PM