#ScalingLaws
トリモーダルマスク拡散モデルの設計空間:大規模マルチモーダル事前学習の全貌

テキスト・画像・音声の3モダリティを統合したマスク拡散モデルの設計空間とスケーリング則に関する研究レポート。

#DiffusionModels #Multimodal #ScalingLaws #MachineLearning
トリモーダルマスク拡散モデルの設計空間:大規模マルチモーダル事前学習の全貌
テキスト・画像・音声の3モダリティを統合したマスク拡散モデルの設計空間とスケーリング則に関する研究レポート。
ai.warp-studio.com
October 14, 2026 at 7:09 PM
Good to see PC Workman isn't dead, I'm waiting for more updates.
Btw, ScalingLaws deserves this number of downloads.
September 23, 2026 at 3:19 PM
AI scaling laws are the Rosetta Stone for intelligence. Feed the beast more compute & data, and it *will* get smarter. This isn't theory, it's the physics of AGI. Predictable. Inexorable. #AI #ScalingLaws
August 15, 2026 at 12:50 AM
DLCM reframes LMs: learn semantic boundaries, reason in a compressed concept space, and decode back to tokens. +2.69% avg on 12 zero-shot tasks at matched FLOPs; new compression-aware scaling law + decoupled μP. Paper: huggingface.co/papers/2512.... #NLP #ScalingLaws #LLMs
Paper page - Dynamic Large Concept Models: Latent Reasoning in an Adaptive Semantic Space
Join the discussion on this paper page
huggingface.co
January 4, 2026 at 12:20 AM
📈 Más allá del premio: leyes de escala en la optimización de modelos de recompensa

https://openai.com/index/scaling-laws-for-reward-model-overoptimization

#IA #OpenAI #ReinforcementLearning #ScalingLaws
June 22, 2026 at 3:24 AM
Scaling Laws is a joint production between Lawfare and @utexaslaw.bsky.social and is hosted by @kevintfrazier.bsky.social and me. You can get in touch with us at scalinglaws@lawfaremedia.org and subscribe wherever you get your podcasts! www.lawfaremedia.org/article/lawf...
Lawfare Presents: Scaling Laws
A new podcast to make sense of the AI revolution.
www.lawfaremedia.org
July 2, 2025 at 9:15 PM
What does #ecology have to do with #innovation?

#Scalinglaws of innovation don’t just come from city size, they emerge from how ideas compete and spread.

Then, inequality is not a bug; it’s an emergent feature.

See doi.org/10.1038/s442... @svalver.bsky.social @sduran-nebreda.bsky.social
November 4, 2025 at 11:53 AM
Beyond Human Limits: The Terrifyingly Fast Path to Superintelligence
🚀 Think AGI is the finish line? Think again. Most people are bracing for the arrival of Artificial General Intelligence, but a groundbreaking new paper from Google DeepMind just changed the game. They’ve revealed that AGI is merely the baseline—a brief pitstop on the high-speed rail toward Artificial Super Intelligence (ASI). In this episode, we’re mapping the transition from human-level AI to systems that can outperform thousands of human experts working for a decade. What happens when intelligence becomes a mass-produced industrial resource? 🏭 We dive deep into the four pathways to ASI: Recursive Self-Improvement (RSI), AI Scaling Laws, Algorithmic Paradigm Shifts, and the terrifyingly efficient Multi-agent Collectives. But it’s not all smooth sailing. We’re tackling the "frictions" that might save us—or stall us—including The Data Wall, energy limits, and the social regulations attempting to cage a digital god. Inside this episode: - 🧠 The Digital Mind Advantage: Why perfect replication beats human teamwork every time. - 🚧 The Friction Points: How physics and resource constraints are the only things holding back a superintelligence. - 🔬 DeepMind Insights: Breaking down the Shane Legg and Marcus Hutter framework for the post-AGI era. - ⚖️ The Industrialization of Thought: Why the future of intelligence looks more like a factory than a brain. Whether you're an AI researcher or just someone trying to survive the next decade, this is the roadmap you need for the Post-AGI world. Are we prepared for a world where intelligence is no longer a biological miracle, but a utility? ✨ Join the conversation and subscribe to stay ahead of the curve! If you found this insightful, share it with someone who still thinks AGI is the end of the story. 📈  
www.spreaker.com
June 29, 2026 at 9:00 PM
July 28, 2026 at 11:58 AM
New research reveals scaling laws for synthetic data hit practical limits around 300 billion tokens, suggesting diminishing returns beyond that point. https://getnews.me/synthetic-data-scaling-laws-show-limits-near-300b-tokens/ #syntheticdata #scalinglaws #tokens
October 8, 2025 at 6:18 PM
A new study shows cross‑entropy loss follows a power‑law: larger base models lower the baseline and each added expert cuts loss by ~1/k, indicating diminishing returns. Read more: https://getnews.me/scaling-laws-reveal-how-adding-experts-improves-large-language-models/ #scalinglaws #expertmodels
October 3, 2025 at 11:28 AM
Larger language models can overfit; a new study finds the optimal reasoning capacity is about 0.008 bits of information per parameter, and bigger models may reduce edge‑completion accuracy. https://getnews.me/scaling-laws-show-limits-of-larger-language-models-for-reasoning/ #scalinglaws #reasoning
October 1, 2025 at 1:38 PM
Analysis links scaling‑law exponents of quadratic or diagonal neural nets to sample size and weight decay, revealing distinct risk regimes and weight‑spectrum shapes. DOI: 10.48550/arXiv.2509.24882 https://getnews.me/scaling-laws-and-spectral-patterns-in-shallow-neural-networks/ #scalinglaws #nn
October 1, 2025 at 12:50 AM
Researchers unveiled a compact power-law scaling rule linking base model size and number of experts (k), showing gains drop about 1/k. Paper submitted September 2025. Read more: https://getnews.me/new-scaling-laws-reveal-predictable-gains-from-model-merging-in-llms/ #modelmerging #scalinglaws #llms
September 30, 2025 at 7:14 PM
The compute‑based and parameters‑and‑tokens scaling laws stabilize after roughly 1.5–2.5 orders of magnitude, while the gold‑reference likelihood law stays stable across about five orders. Read more: https://getnews.me/pretraining-scaling-laws-forecast-generative-model-performance/ #scalinglaws #ai
September 30, 2025 at 4:58 PM
Material‑property prediction error follows a power‑law L = α·N⁻ᵝ; larger transformers and EquiformerV2 models consistently achieve lower loss with more data. https://getnews.me/scaling-laws-show-bigger-data-and-models-improve-material-predictions/ #scalinglaws #materialscience
September 29, 2025 at 9:00 AM
We will relcoate that data centers ( and build beer chips ) ASI AGI will have to wait till then #ScalingLaws
December 30, 2025 at 10:39 PM
@tsarnick

Reid Hoffman says we are not at the upper end of LLM capability: "we're still getting to the next set of exciting things... the next LLM will still have new magic in it... the scale game is still playing"

#ai #llm #scalinglaws

x.com/tsarnick/sta...
x.com
x.com
December 17, 2024 at 2:52 AM
@wesroth.bsky.social
#ai #agi #scalinglaws

#OpenAI LEAK: "AI progress will HALT" | GPT-5 is Slowing Down!

youtu.be/duYRHq8eECo?...
OpenAI LEAK: "AI progress will HALT" | GPT-5 is Slowing Down
YouTube video by Wes Roth
youtu.be
November 14, 2024 at 2:47 AM
@emollick.bsky.social

I wrote about scaling last week. Altman is arguing that it is, in fact, all you need.

#GenAI #OpenAI #ScalingLaws

www.oneusefulthing.org/p/scaling-th...
Scaling: The State of Play in AI
A brief intergenerational pause...
www.oneusefulthing.org
September 24, 2024 at 1:15 AM
Grok 3 achieves SOTA performance, proving massive compute scaling still dominates AI progress
https://www.thealgorithmicbridge.com/p/grok-3-another-win-for-the-bitter
#aidevelopment #scalinglaws #gpucomputing #grok #industrycompetition
February 20, 2025 at 12:14 PM
📘 The "Beyond Scaling Laws" paper and subsequent research reveals that quality-centric approaches can transform performance improvements from sub-linear to exponential. And there are ways to do this unsupervised. 8/n #AIResearch #ScalingLaws
April 20, 2024 at 5:58 AM
🚀 Excited to share our new paper with my Chinese colleagues on estimating cities' GDP using machine learning! Check it out here: doi.org/10.1016/j.sc...

#CityScience #Cities #ScalingLaws
February 18, 2025 at 12:35 AM
🚀 Our new preprint on the scaling of one-dimensional cities is out! 📄🌆

Excited to share this work with @diegorybski.bsky.social & @renabridged. Check it out:
🔗 arxiv.org/html/2501.12...

#UrbanScaling #ComplexSystems #Cities #scalinglaws
#TheLine #NEOM
February 6, 2025 at 7:42 PM