#ArtificialAnalysis
Is ArtificialAnalysis biased against open weight models?

Reddit users allege that ArtificialAnalysis systematically recalibrates benchmarks to disadvantage open-weight models when they approach proprietary US model performance. Critics claim the platform's "intelligence index"…
Is ArtificialAnalysis biased against open weight models?
Reddit users allege that ArtificialAnalysis systematically recalibrates benchmarks to disadvantage open-weight models when they approach proprietary US model performance. Critics claim the platform's
techyon.pages.dev
November 10, 2026 at 2:27 PM
Google just dropped Gemini 4 Carbon, the fastest model cycle yet, and claims Argon beats Anthropic’s Fable 5.2 on reasoning intensity. Curious how the new Artificial Analysis benchmark reshapes LLM rankings? Dive in! #Gemini4Carbon #Gemini4Argon #ArtificialAnalysis

🔗 aidailypost.com/news/gemini-...
November 10, 2026 at 6:36 PM
Google представила новый бенчмарк MKA для AI-агентов!
Google #DeepMind и #ArtificialAnalysis запустили #MKA — новый тест для оценки того, насколько хорошо AI-агенты работают со сложными визуальными файлами и реальными профессиональными задачами.

gorogly.com/ru/ai/google...
Google представила новый бенчмарк MKA для AI-агентов
Google DeepMind и Artificial Analysis запустили MKA — новый тест для оценки того, насколько хорошо AI-агенты работают со сложными визуальным.
gorogly.com
November 11, 2026 at 6:22 PM
📰 Reddit r/LocalLLaMA
Is ArtificialAnalysis biased against open weight models?

https://www.reddit.com/r/LocalLLaMA/comments/1xs5pkl/is_artificialanalysis_biased_against_open_weight/

#IA #AI #ML
November 9, 2026 at 11:00 PM
Claude Opus 5.5 tops a 132-model AI index with a score of 58, and its closest rival, Alibaba's Qwen 4, isn't even out yet.

#AI #ClaudeOpus #ArtificialAnalysis

autonainews.com/claude-opus-5…
Claude Opus 5.5 Leads AI Index With Score of 58 Across 132 Models
Claude Opus 5.5 currently sits atop the Artificial Analysis Intelligence Index with a score of 58 across 132 evaluated models, while its nearest emerging rival, Alibaba ’s Qwen 4, remains in training…
autonainews.com
November 10, 2026 at 5:32 AM
Gemini 4 Carbon: Google lo reserva para ciberseguridad

Gemini 4 Carbon, el modelo más potente de Google, llega primero a los defensores de ciberseguridad. Descubrí por qué el resto deberá esperar acá.

#gemini4carbon #googledeepmind #ciberseguridad #fairwind #artificialanalysis
Gemini 4 Carbon: Google lo reserva para ciberseguridad
Google lanzó Gemini 4 Carbon pero solo lo entrega a defensores de ciberseguridad vía Fairwind. Benchmarks, precios y qué falta para el acceso público.
blog.donweb.com
October 30, 2026 at 3:21 AM
Gemini 4 Carbon: Google lo reserva para ciberseguridad

Gemini 4 Carbon, el modelo más potente de Google, llega primero a los defensores de ciberseguridad. Descubrí por qué el resto deberá esperar acá.

#gemini4carbon #googledeepmind #ciberseguridad #fairwind #artificialanalysis
Gemini 4 Carbon: Google lo reserva para ciberseguridad
Google lanzó Gemini 4 Carbon pero solo lo entrega a defensores de ciberseguridad vía Fairwind. Benchmarks, precios y qué falta para el acceso público.
blog.donweb.com
October 30, 2026 at 3:21 AM
Omniscience public questions still look like this:

"In the juvenile green turtle magnetic displacement experiment conducted near Melbourne Beach, Florida, what was the distance (in kilometers, to the nearest kilometer) between the outdoor test site and each simulated location along the coast?"
ArtificialAnalysis/AA-Omniscience-Public-v1.1 · Datasets at Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
October 28, 2026 at 11:59 AM
winbuzzer.com/2026/10/28/a...

The new Artificial Analysis’ Intelligence Index v5 bases 60% of its score on private tests and adds new coding and science tasks. No single AI model leads them all.

#AI #AIBenchmarks #ArtificialAnalysis #AIModels
October 28, 2026 at 7:16 PM
in its category on artificialanalysis, that is, for whatever those benchmarks remain good for

anyway, should the takeaway here be that Anthropic sucks at making models or that China is not simply stealing America's homework
October 27, 2026 at 1:31 PM
October 12, 2026 at 8:56 PM
MetaがMuse Wonderなるモデルを発表した

Muse WonderとMuse Wonder Fullの2モデル(FullはAPI公開まだ)

ArtificialAnalysisを見る限りは、Fableとかに匹敵している
トークン使用は多くないらしいけど、そもそもの値段の関係でGPTよりは割高

3D系は学習していないらしく、Xでも性能の悪さが指摘されている
普通のコーディングタスクではClaudeに劣るという評価もある

個人的には性能よりも命名のほうが気になる
前はSparkという名前だったが、別のモデルシリーズの名前になった
Muse Spark 2とかじゃだめだったのかな
October 12, 2026 at 9:24 PM
Started replicating my own home version of ArtificialAnalysis.

Calling it the LocalAnalysis index. Literally just the parts of the Artificial Analysis bench that doesn't require a grader api. Actually harder than just sending a harness into a repo filled with test questions, which surprised me.
October 10, 2026 at 11:41 PM
Xiaomi открыла MiMo-V2.6-Pro и Flash: лучшая модель с открытыми весами в рейтинге Artificial Analysis

Xiaomi выложила под лицензией MI…

Подробнее: https://gruzdevv.ru/news/xiaomi-vypustila-mimo-v2-6-pro-i-flash/

#Xiaomi #MiMoV2 #открытыевеса #нейросети #ArtificialAnalysis #ITНовости #Технологии
October 7, 2026 at 11:20 AM
ArtificialAnalysis has made some weird decisions about rating that I didn’t totally follow. Their placement for Qwen3.8 27B in particular seems very strange.
September 30, 2026 at 12:41 AM
New from ArtificialAnalysis: The price of compute per KG set to surpass the price of cocaine in 2029
September 26, 2026 at 10:28 PM
ArtificialAnalysis claims Xiaomi MiMo 2.6 Pro (Which is a 1TA42B model) is delivering roughly 6 Sol performance at ~5.6 Luna prices, so. There's that.
September 25, 2026 at 8:41 PM
Faster. Not smarter. Mercury 2.5 runs 770 tokens per second, burns 35M tokens to score 12 on the Artificial Analysis index, where the median model burns 85M to hit 13. One point less smart, the basics dialed.

#artificialanalysis

https://links.madcoolsocial.com/eXhAE2F
September 24, 2026 at 5:10 PM
GPT-6 Sol, Luna

噂通り発表された
Terraが消えるというのも噂通り

ArtificialAnalysisのベンチマークでは性能はそれほぼ変わっていない
一方、APIでは半額くらいになっていて、コストパフォーマンスがいいモデルとなっている
トークン使用量も大きくは変わっていなくて、APIの値下げは直接感じられるはず

Astraもでて、Terraの立ち位置が微妙になったのだろうが、このように命名法則がすぐに変わっていくと追っている側としてはやりづらい

Claude Opus 5.5も同日に発表されていて、Grok 4.7も先日発表されたし、競争が激化している
September 22, 2026 at 9:33 PM
Claude Opus 5.5

ArtificialAnalysisのベンチマークを見ると、Opus 5から性能が大幅に向上し、Fableをも上回る結果を出している
API価格も20%引きとなったが、トークン使用量も増え結局は値段は同じくらいになってしまっている

今まではAPIの価格は上がる一方だったが、トップ2社が価格を下げる方向に進んでいて、コスパも注視しているのが分かる

個人的にはトップモデルが必要なことは多くなく、それなりの性能のモデルが安く使えるなら歓迎する
September 22, 2026 at 9:49 PM