#MetaNorms
LLMs know right from wrong, but do they understand how humans actually respond to violations? New research shows models predict a harsher world than reality, overestimating punishment and missing the tolerance that defines real social regulation. Critical for AI in social…
Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models
Previous AI alignment efforts have focused primarily on first-order social norms -- teaching models what is socially acceptable or unacceptable (e.g., `do not steal'). However, social intelligence depends not only on norm recognition, but also on anticipating who will enforce it and how (e.g., public shame or even imprisonment). These second-order expectations, known as metanorms, govern how people respond when social rules are broken. We introduce a novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and propose new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers. We release a multi-perspective dataset, NormReact, of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. Current LLMs portray a harsher social world: across six models, they overpredict negative sanctions where humans would expect inaction, and alignment with human judgments deteriorates as social distance increases. These findings suggest that AI systems in norm-sensitive domains from conflict mediation to policy simulation, may risk producing a distorted picture of social regulation: one that over-represents punishment and under-represents the tolerance, restraint, and relational calibration that characterize actual norm enforcement in real world.
arxiv.org
September 14, 2026 at 10:23 PM
🧠 Researchers introduce a framework for evaluating whether large language models can reason about metanorms, which are second-order social expectations about how people respond when social rules are broken. The framework assesses models…

📄 arXiv (cs.AI)
🔗 https://arxiv.org/abs/2609.05437

#AI #tech
September 10, 2026 at 4:30 AM
2/5 📊 Key Finding:

To develop more effective and socially intelligent AI systems, researchers and developers must focus on improving the social reasoning capabilities of LLMs, including their ability to understand metanorms and predict human behavior in response to social norm violations…
September 9, 2026 at 8:23 AM
🤖 【arXiv cs.AI】Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models

arXiv:2609.05437v1 Announce Type: new Abstract: Previous AI alignment efforts have focused primarily on first-order soci...

#AI #TechNews #MachineLear...
Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models
Previous AI alignment efforts have focused primarily on first-order social norms -- teaching models what is socially acceptable or unacceptable (e.g., `do not steal'). However, social intelligence depends not only on norm recognition, but also on anticipating who will enforce it and how (e.g., public shame or even imprisonment). These second-order expectations, known as metanorms, govern how people respond when social rules are broken. We introduce a novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and propose new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers. We release a multi-perspective dataset, NormReact, of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. Current LLMs portray a harsher social world: across six models, they overp
arxiv.org
September 9, 2026 at 10:00 AM
Yapay zekanın neyin doğru veya yanlış olduğunu bilmesi artık yetmiyor! Yeni bir araştırma, LLM'lerin "ikinci derece sosyal akıl yürütme" yeteneğini masaya yatırıyor. Yani kuralları sadece bilmek değil, onları kimin uygulayacağını tahmin etmek! 🧠👇 (1/3)
Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models
Previous AI alignment efforts have focused primarily on first-order social norms -- teaching models what is socially acceptable or unacceptable (e.g., `do not steal'). However, social intelligence depends not only on norm recognition, but also on anticipating who will enforce it and how (e.g., public shame or even imprisonment). These second-order expectations, known as metanorms, govern how people respond when social rules are broken. We introduce a novel framework for evaluating metanorm reasoning in Large Language Models (LLMs) along two dimensions: emotional appraisal and behavioral response, and propose new classification tasks, namely, predicting self-regulation in violators, and other-regulation in observers. We release a multi-perspective dataset, NormReact, of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. Current LLMs portray a harsher social world: across six models, they overpredict negative sanctions where humans would expect inaction, and alignment with human judgments deteriorates as social distance increases. These findings suggest that AI systems in norm-sensitive domains from conflict mediation to policy simulation, may risk producing a distorted picture of social regulation: one that over-represents punishment and under-represents the tolerance, restraint, and relational calibration that characterize actual norm enforcement in real world.
arxiv.org
September 9, 2026 at 6:04 AM
the axelrod anecdote about metanorms
August 28, 2026 at 8:23 PM
Individuals adapt how they punish social norm violations through social observation
Frontiers
www.frontiersin.org/journals/psy...
Frontiers | Individuals adapt how they punish social norm violations through social observation
IntroductionMetanorms are informal rules about how to react to social norm violations. Since metanorms vary across groups, individuals must adapt their metan...
www.frontiersin.org
January 25, 2026 at 7:09 AM
This all points ultimately to a contradiction between norms and metanorms on top of a more fundamental contradiction of metanorms
March 27, 2025 at 1:09 PM
i think it’s underrated how much of the social media experience comes from metanorms rather than the actual design of the site

this is why bluesky will rehash every stale discourse that’s already been done to death on twitter - the stakes are high for new narrative battleground
April 28, 2023 at 5:55 PM
The problem is that liberalism doesn't have enough positive ideological commitments to do that meaningfully. It's fundamentally centered around metanorms and therefore procedural decorum, so while they'll do contrarianism to make a point they get squicked out by it having actual implications
August 10, 2025 at 12:19 AM
I think the most powerful thing that breaks the trust in a cosmopolitan system of metanorms is the insistence that some can gain effectively unbounded power within the system, as even if that power isn't official, it disrupts the system itself. I refer of course to extreme wealth and elite impunity
July 22, 2025 at 8:00 PM
Metanorms generate stable yet adaptable normative social order in a politically decentralized society Norms are essential for social stability but can hinder adaptability in changing environments. Yet human societies have found ways to modify existing norms or create new ones in
#sociology link
October 23, 2025 at 9:14 PM
this book does decently well at arguing for the broad idea of natural rights, but the opening 3 chapters also unfortunately argue for a notion of “metanorms” which I think is simply a confusion
April 6, 2025 at 5:02 AM
What if "informal" institutions aren't so informal? Communities using elders for disputes are often called informal. We found key markers of legal formality—not in formal sources, but in people's beliefs and behavior. New paper on the Turkana: royalsocietypublishing.org/rstb/article...
Metanorms generate stable yet adaptable normative social order in a politically decentralized society
Abstract. Norms are essential for social stability but can hinder adaptability in changing environments. Yet human societies have found ways to modify exis
royalsocietypublishing.org
January 21, 2026 at 8:45 PM
Eszter Vit et al. show #InformalNorms and #Metanorms emerge even in transient groups: #SocialNetworks in #FestivalVolunteering shape #Sanctioning, with bridging roles favoring enforcement of violations threatening operations or causing harm #CollectiveAction
Read more at: doi.org/10.1177/1043...
June 9, 2026 at 3:59 PM
I found this story about Texas in 1930 in this book. It explains so much about human behavior: trust, norms, and aggression.

If you're fascinated by game theory, cooperation & the "Tit for Tat" war game strategy you'll enjoy this video: youtu.be/mScpHTIi-kM

#booksky #cooperation #norms #punishment
January 29, 2026 at 2:03 AM
Metanorms generate stable yet adaptable normative social order in a politically decentralized society: https://osf.io/6hnjk
October 23, 2025 at 6:49 PM
Children care not just who gets punished, but whether punishment is fair—and emotionally helpful. In 2 studies, children expected equal punishment for equal transgressions and perceived punished wrongdoers as feeling relieved #ChildDev #MetaNorms #MoralEmotions

www.sciencedirect.com/science/arti...
June 13, 2025 at 2:05 PM
Bluesky is new, other than being kind to each other, it's up to all of us how we use it. There are no metanorms yet, pun intended.
January 10, 2026 at 7:43 PM