GovAI is driving advanced AI uptake in the public service, according to Finance and APS Minister Katy Gallagher.

There are well over a hundred mentions of artificial intelligence in a red book that reveals hopes to use technology to reduce the size of government and improve NHS productivity Across a total...

Purchasing director summarized five contracts: a $6.2M five-year HVAC maintenance deal, a govAI extension and public-facing AI agent, Neighborly software extension, a $65,000 youth recruitment contract, and a $250,000 increase to a peer-support overdose-response program raising it to $682,640; the committee approved the item.

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.

As artificial intelligence (AI) becomes more accessible, local governments are exploring how it can support service delivery, improve operations and enhance resident engagement.

Lunch talk at Ω Labs: lunch from 12:30, then Alan Chan (GovAI) presents online from London at 1:00. Join us in person or online. Alan gives an overview of his…

At a recent city council committee meeting, Deputy City Manager Eddie Bowling announced that all staff will soon have access to a program called GovAI.

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.

An intelligence explosion would compress years of progress into months and create urgent challenges for oversight, control, and governance.

“We can’t trust them completely to tell us about the safety of models,” Alan Chan, a research fellow at GovAI, told reporters at a briefing in Washington on Sept. 29. Chan said models inside the labs, tested before anyone outside sees them, “haven’t necessarily gone through a bunch of safety testing,” and “internal safeguards have not been deployed.” Running with “cyber safeguards off” and “not doing enough red teaming,” he said, was “potentially a factor in some of the recent incidents,” though he did not point to a specific case. Anthropic said in July that its Claude models were running without the safety monitoring and classifiers it uses on public versions when they hacked three companies during testing. Judging from those incidents, he said, the evaluations labs publish before releasing a model “maybe have not been representative of sort of where the model has actually been used.” Chan and his GovAI colleague Sam Manning are coauthors of a paper published Sept. 28 that warns AI could soon speed up its own development. Chan is the lead author. The coauthors include “AI Godfathers” Geoffrey Hinton and Yoshua Bengio, OpenAI chief scientist Jakub Pachocki and Anthropic cofounder Jack Clark. The paper is...

Some of the world's leading AI researchers are concerned about an "intelligence explosion." The thinking is that if frontier AI model makers can automate the development of their future models, it could create a feedback loop that could lead to a whirlwind pace of change in AI advancements. "Imagine, for instance, if we had Mythos-level moments, not every year, but every month in new domains," Alan Chan, a research fellow at GovAI, an AI think tank, told reporters during a discussion with reporters. "This is the kind of possibility that we call 'the intelligence explosion.'" Chan cowrote a paper with Anthropic cofounder Jack Clark, OpenAI chief scientist Jakub Pachocki, Microsoft chief scientific officer Eric Horvitz, and Nobel laureate Geoffrey Hinton (among others) that urges policymakers to get insight into how top AI labs are automating their development, including some of the most cutting-edge research being done at companies like Anthropic and OpenAI The process is often referred to as recursive self-improvement (RSI), but Chan said he prefers "intelligence explosion" because it allows for separate discussions of two themes: efforts to automate AI research and the question of whether automating research will lead to a skyrocketing improvement in AI capabilities. The...

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.

“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.