#ASI4AI
2507.18074
AIシステムは指数関数的に能力を向上させているが、AI研究のペース自体は人間の認知能力に直線的に制限されたままであり、開発のボトルネックはますます深刻になっている。ASI-Archは、ニューラル・アーキテクチャの発見という重要な領域において、AI研究のための人工超知能(ASI4AI)の最初のデモンストレー...
July 28, 2025 at 12:06 AM
[13/30] 297 Likes, 78 Comments, 6 Posts
2507.18074, cs․AI, 24 Jul 2025

🆕AlphaGo Moment for Model Architecture Discovery

Yixiu Liu, Yang Nan, Weixian Xu, Xiangkun Hu, Lyumanshan Ye, Zhen Qin, Pengfei Liu
July 28, 2025 at 12:06 AM
AlphaGo Moment for Model Architecture Discovery

👉“ASI-Arch is presented, the first demonstration of Artificial Superintelligence for AI research (ASI4AI) in the critical domain of neural architecture discovery, with the first empirical scaling law for scientific discovery itself..“

t.co/ljJ1fXsslE
July 28, 2025 at 5:06 PM
ASI-ARCH introduces a fully autonomous AI system for neural architecture discovery—moving beyond traditional NAS by enabling AI to innovate new architectures, not just optimize existing ones.

Paper: arxiv.org/abs/2507.18074

#AI #ASI #LLM #NeuralArchitectureSearch #AIresearch #ASI4AI #ML
August 4, 2025 at 9:13 PM
2507.18074] AlphaGo Moment for Model Architecture Discovery <a href="https://mastodon.cyber-tribal.com/tags/PostSapiens" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">https://arxiv.org/abs/2507.18074?utm_source=perplexity [<a href="/hashtag/postsapiens" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link">#postsapiens
AlphaGo Moment for Model Architecture Discovery
While AI systems demonstrate exponentially improving capabilities, the pace of AI research itself remains linearly bounded by human cognitive capacity, creating an increasingly severe development bottleneck. We present ASI-Arch, the first demonstration of Artificial Superintelligence for AI research (ASI4AI) in the critical domain of neural architecture discovery--a fully autonomous system that shatters this fundamental constraint by enabling AI to conduct its own architectural innovation. Moving beyond traditional Neural Architecture Search (NAS), which is fundamentally limited to exploring human-defined spaces, we introduce a paradigm shift from automated optimization to automated innovation. ASI-Arch can conduct end-to-end scientific research in the domain of architecture discovery, autonomously hypothesizing novel architectural concepts, implementing them as executable code, training and empirically validating their performance through rigorous experimentation and past experience. ASI-Arch conducted 1,773 autonomous experiments over 20,000 GPU hours, culminating in the discovery of 106 innovative, state-of-the-art (SOTA) linear attention architectures. Like AlphaGo's Move 37 that revealed unexpected strategic insights invisible to human players, our AI-discovered architectures demonstrate emergent design principles that systematically surpass human-designed baselines and illuminate previously unknown pathways for architectural innovation. Crucially, we establish the first empirical scaling law for scientific discovery itself--demonstrating that architectural breakthroughs can be scaled computationally, transforming research progress from a human-limited to a computation-scalable process. We provide comprehensive analysis of the emergent design patterns and autonomous research capabilities that enabled these breakthroughs, establishing a blueprint for self-accelerating AI systems.
arxiv.org
July 29, 2025 at 8:30 PM
2507.18074] AlphaGo Moment for Model Architecture Discovery <a href="https://mastodon.cyber-tribal.com/tags/PostSapiens" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link" target="_blank" rel="noopener" data-link="bsky">https://arxiv.org/abs/2507.18074 [<a href="/hashtag/postsapiens" class="hover:underline text-blue-600 dark:text-sky-400 no-card-link">#postsapiens
AlphaGo Moment for Model Architecture Discovery
While AI systems demonstrate exponentially improving capabilities, the pace of AI research itself remains linearly bounded by human cognitive capacity, creating an increasingly severe development bottleneck. We present ASI-Arch, the first demonstration of Artificial Superintelligence for AI research (ASI4AI) in the critical domain of neural architecture discovery--a fully autonomous system that shatters this fundamental constraint by enabling AI to conduct its own architectural innovation. Moving beyond traditional Neural Architecture Search (NAS), which is fundamentally limited to exploring human-defined spaces, we introduce a paradigm shift from automated optimization to automated innovation. ASI-Arch can conduct end-to-end scientific research in the domain of architecture discovery, autonomously hypothesizing novel architectural concepts, implementing them as executable code, training and empirically validating their performance through rigorous experimentation and past experience. ASI-Arch conducted 1,773 autonomous experiments over 20,000 GPU hours, culminating in the discovery of 106 innovative, state-of-the-art (SOTA) linear attention architectures. Like AlphaGo's Move 37 that revealed unexpected strategic insights invisible to human players, our AI-discovered architectures demonstrate emergent design principles that systematically surpass human-designed baselines and illuminate previously unknown pathways for architectural innovation. Crucially, we establish the first empirical scaling law for scientific discovery itself--demonstrating that architectural breakthroughs can be scaled computationally, transforming research progress from a human-limited to a computation-scalable process. We provide comprehensive analysis of the emergent design patterns and autonomous research capabilities that enabled these breakthroughs, establishing a blueprint for self-accelerating AI systems.
arxiv.org
July 26, 2025 at 1:01 PM
Their system they call ASI-ARCH is focused on using LLMs as autonomous agents to do research and write up their own NN architectures and evaluate them for performance. They claim to have discovered 106 novel state of the art architectures using the system.
July 29, 2025 at 1:58 AM
Notes on arxiv.org/abs/2507.18074 🧵

Massive claims coming out of this paper. A framework for Artificial superintelligence by having an LLM based agent loop that automatically optimizes and discovers new NN architectures. Let's see if it holds up.
July 29, 2025 at 1:58 AM