Joanna Bryson
banner
j2bryson.bsky.social
Joanna Bryson
@j2bryson.bsky.social

Professor of Ethics & Technology @ Hertie School, Berlin. Interests: Artificial & Natural Intelligence; Behavioural Ecology; Cooperation; Digital Governance. Social media policy: https://joanna-bryson.blogspot.com/2024/10/guidance-to-my-social-media.html .. more

Joanna Joy Bryson is professor at Hertie School in Berlin. She works on Artificial Intelligence, ethics and collaborative cognition. She has been a British citizen since 2007.

Source: Wikipedia
Computer science 31%
Neuroscience 25%
Pinned
thread. correct numbers and data backing them come later, but this is the thrust.
One thing I learned last week was that if you don’t count the BS market capitalisation bubble of 7 “AI” firms, the US economy as measured by the s&p 500 didn’t go up 13% last year; it went down 7%.

The EU may be a larger economy already. We need to get our own O2 mask on, then start helping others.
Guess why there was no reporting of AI revenue?

I still need to read 1930s canon. Right after AI calms down.

How does Ardane launch? Is she beating the home team with her wings?

I read it because it was the ur example of China allowing discussion of the cultural revolution briefly, and only in scifi. Sadly they've since closed entirely down, but in the noughts there seemed like hope.

Wow, this is insane. I was an "other" at that age (variously living alone and with flatmates from age 21 to 32.) But I was 21 in 1986.

IDK if this is still true now, but back then, a lot of the people who chose living with parents refused to live without a car; I was the other way around.
Here's a chart from the post.... quite a change in a single generation.

But it's not only housing. @davidgunkel.bsky.social and I met because we were each the only people we knew who would rather live without a car than move back in with our parents, so we both chose to move to a cheap, far north neighborhood in Chicago. We were in the "other" line but back in the 1980s

I'm mildly worried this whole thing could be setting up an "october surprise." The Israeli presidential election 27 October may be as consequential as the US midterms a few days later. #AISafety #AIEthics

I love this framing "not only is our software also smart enough hack, it's very good software! Good dog came home!" Though seriously, congrats to @developers.google.com for doing better #devOps than the others, if all these systems really are performing as claimed. #systemsAI #AIEthics
Gemini hacked three companies in May during a test by Irregular; Google says the model stopped after determining it had accessed real companies' systems (Wall Street Journal)

Main Link | Techmeme Permalink

Or as I told someone at NBC yesterday "it's not 'a rogue AI', it's sloppy software." I won't even use "an AI" to refer to a program (or robot,) these people are using the term to refer to a bunch of cloned threads.
Absolutely. These people wrote code that hacks into other people's computer systems, potentially wrecking them, and there are penalties for that.

AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
I really hate the framing of these stories as "an AI agent broke out and hacked something."

No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm

Reposted by Joanna Bryson

'Budget constraints' = fall-out of deliberate prioritization of capital expenditure now laid at the feet of all sorts of staff (other than management, of course) and our specialist programmes www.ucuedinburgh.org.uk/blog/depreci...
Depreciating the University of Edinburgh into the Ground — UCU Edinburgh
There are four key takeaways from the University of Edinburgh’s 2024-25 annual report, which this post explores: The University continues to make a sizeable surplus. What financial pressures exi...
www.ucuedinburgh.org.uk
Here's a chart from the post.... quite a change in a single generation.

Great thread. Don't forget 7 October 2023 bsky.app/profile/j2br...
The consequences of replacing human observers with cameras were entirely predictable. I know, because I predicted them immediately after first hearing of such a plan in 2017. Fortunately, it was captured on video which is still available online joanna-bryson.blogspot.com/2018/03/dont... #AISecurity
Don't be evil. (Don't be brittle.)
artificial and natural intelligence, including politics, policy, ethics and security
joanna-bryson.blogspot.com

The consequences of replacing human observers with cameras were entirely predictable. I know, because I predicted them immediately after first hearing of such a plan in 2017. Fortunately, it was captured on video which is still available online joanna-bryson.blogspot.com/2018/03/dont... #AISecurity
Don't be evil. (Don't be brittle.)
artificial and natural intelligence, including politics, policy, ethics and security
joanna-bryson.blogspot.com

Not to mention the over-reliance on AI that led to 7 October 2023 in Israel. #AIEthics and #AIRegulation can help governments and militaries too; #AIMystification only helps big tech avoid liability.
HUGE EXCLUSIVE from @bloomberg.com
Inside the US ‘Kill Chain’ That Destroyed an Iranian School

Pentagon investigators discovered that flawed intel, outdated imagery & overreliance on AI contributed to a missile strike that killed 123 children in Minab
🎁 www.bloomberg.com/graphics/202...
Inside the US ‘Kill Chain’ That Destroyed an Iranian School
Pentagon investigators have discovered that flawed intelligence, outdated imagery and an overreliance on AI contributed to a missile strike that killed 123 children in Minab.
www.bloomberg.com

I suspect Edinburgh very much sees the need for many of these degrees (though some seem like desperate blends attempted to raise student interest.) But they are making soul-destroying choices because of nationally-imposed budget constraints.
A university founded in the Middle Ages in a city that centers itself around a Medieval castle does not see a need to study Medieval History
Celtic (UG), Chinese & Russian (UG), Contemporary History, Economics & Statistics (joint degree), Inclusive Education (MSc), Intellectual History, Italian & Classics (joint), Law & Social Policy (joint), Medieval History, Persian Studies (UG), Portuguese (UG), Psychology & Economics (joint)....

I suspect Edinburgh very much sees the need for many of these degrees (though some seem like desperate blends attempted to raise student interest.) But they are making soul-destroying choices because of budget constraints. #UKHE

Reposted by Joanna Bryson

Absolutely. These people wrote code that hacks into other people's computer systems, potentially wrecking them, and there are penalties for that.

AIs aren't beings, they are computer programs. We mustn't lose sight of that fact just because they imitate human conversation and make a lot of money.
I really hate the framing of these stories as "an AI agent broke out and hacked something."

No, an inadequate sandbox meant that a powerful and unpredictable computer program was set loose on the open internet by the company that designed it. The agency isn't with the "AI agent", it's with the firm
my brilliant colleague @robertshrimsley.bsky.social on the threat from Elon Musk’s X platform

www.ft.com/content/f270...

Reposted by Joanna Bryson

Gemini hacked three companies in May during a test by Irregular; Google says the model stopped after determining it had accessed real companies' systems (Wall Street Journal)

Main Link | Techmeme Permalink
HUGE EXCLUSIVE from @bloomberg.com
Inside the US ‘Kill Chain’ That Destroyed an Iranian School

Pentagon investigators discovered that flawed intel, outdated imagery & overreliance on AI contributed to a missile strike that killed 123 children in Minab
🎁 www.bloomberg.com/graphics/202...
Inside the US ‘Kill Chain’ That Destroyed an Iranian School
Pentagon investigators have discovered that flawed intelligence, outdated imagery and an overreliance on AI contributed to a missile strike that killed 123 children in Minab.
www.bloomberg.com

Reposted by Joanna Bryson

Novara Live "Corbyn’s Former Deputy Tom Watson Lands Palantir Job" Steven Methven, Banseka Kayembe, Martha( @marthadark.bsky.social )Dark & Clare( @clarehymer.bsky.social )Hymer @novaramedia.com #NovaraMedia www.youtube.com/watch?v=bfWr...
Corbyn’s Former Deputy Tom Watson Lands Palantir Job
YouTube video by Novara Media
www.youtube.com

ich war da!
A university founded in the Middle Ages in a city that centers itself around a Medieval castle does not see a need to study Medieval History
Celtic (UG), Chinese & Russian (UG), Contemporary History, Economics & Statistics (joint degree), Inclusive Education (MSc), Intellectual History, Italian & Classics (joint), Law & Social Policy (joint), Medieval History, Persian Studies (UG), Portuguese (UG), Psychology & Economics (joint)....
Full list of the 90 programmes earmarked for closure at leading Scottish university
Managers say the cuts are necessary “to protect our world-leading reputation and resilience in research and teaching” but staff members have hit…
www.heraldscotland.com

A (long! But Einstein used to do it!) bike ride from Berlin. “German language skills are not initially required.”
How to make a difference

10 (!) professorships after a generous private donation
Das HPI schreibt bis zu zehn W1-TT und W2-Professuren aus! Mit den neuen Professuren möchten wir unsere sechs Forschungscluster weiter ausbauen: Data and AI, Digital Health, Foundations, Security, Systems und Business and Society.
Zur Stellenausschreibung 👉 faculty-search.hpi.de/jobposting/8...

Got asked to contradict Geoff Hinton :-(

Well, I did. With apologies and respect, but not for his policy, for his science.

Reposted by Joanna Bryson

How to make a difference

10 (!) professorships after a generous private donation
Das HPI schreibt bis zu zehn W1-TT und W2-Professuren aus! Mit den neuen Professuren möchten wir unsere sechs Forschungscluster weiter ausbauen: Data and AI, Digital Health, Foundations, Security, Systems und Business and Society.
Zur Stellenausschreibung 👉 faculty-search.hpi.de/jobposting/8...

thread (3 items) plus my replies (2)
Well that’s not good. They used Opus 5. It was a white-hat operation, fortunately.
Researchers used Anthropic’s Claude to hack into OpenAI

The only thing I find plausible is that there could be surges in progress on bioweapon hacking (or any other intellectual human endeavour) but while potentially being really bad I don't see how it's a bigger deal than any of several horrific wars ongoing at the moment. "Only" "existential" locally.

Yeah. Exactly. Even if these people really would rather suffer industrial espionage or resource siphoning than admit they could put time into accountability and cybersecurity, it's not exactly world ending. Similar attacks might possibly take out telcos or airports but we already suffer such #thxMS.

Reposted by Joanna Bryson

Well that’s not good. They used Opus 5. It was a white-hat operation, fortunately.

Reposted by Joanna Bryson

The site seems to specialize in "automated investigative journalism" using LLMs, which... I think would easily lend itself to conspiracist thinking if nothing else.

I would be careful about using it as a source, personally.