#EpochAI
It seems that OpenAI's latest model, o3, can solve 25% of problems on a database called FrontierMath, created by EpochAI, where previous LLMs could only solve 2%. On Twitter I am quoted as saying, "Getting even one question right would be well beyond what we can do now, let alone saturating them."
December 20, 2024 at 11:15 PM
Marked the fraction of DC cost that data centers in Space _might_ reduce while significantly complicating the remaining 90% of line items. Convincing proposition.

[Data: EpochAI]
June 26, 2026 at 6:12 AM
New math benchmark from math.science-bench.ai :

209 research-level mathematics problems from Combinatorics, Algebra, Geometry, Number Theory, and others.

👉 math.science-bench.ai/benchmarks/

#AI #Mathematics #AIBenchmark #EpochAI #FrontierMath #OpenAI #Gemini #Grok
November 1, 2025 at 2:18 PM
EpochAI is next to throw in the gauntlet in the "solving open problems with AI" game
open.substack.com/pub/aichats/...
EpochAI is next to throw in the gauntlet in the "solving open problems with AI" game
A critical review of the recent claims by EpochAI that frontier models solved an open FrontierMath problem with the assistance of Gemini.
open.substack.com
March 25, 2026 at 9:48 AM
Epochai unveils FrontierMath, an AI benchmark for advanced mathematical reasoning.
epochai.org/frontiermath
FrontierMath
epochai.org
November 8, 2024 at 10:46 PM
EpochAI releases a database of over 1,100 biological AI models across nine categories, analyzing their safeguards, accessibility, training data sources, and the foundation models they build on epoch.ai/blog/expandi... #biosecurity
March 6, 2026 at 7:00 PM
* = They "FrontierMath/EpochAI"
January 19, 2025 at 8:23 PM
Model o3 rozwiązał trochę ponad 25% problemów ze zbioru EpochAI Frontier Math (epoch.ai/frontiermath), gdzie każdy problem wymaga godzin pracy od ekspertów matematyków. Niedawno mówiłem, że matematyka będzie pierwszą dziedziną, gdzie AI będzie wspierać badania naukowe (www.pap.pl/aktualnosci/...)
December 20, 2024 at 8:57 PM
RT @AuthoStats: AA Intelligence Index uses their own harness. Most costs are from 3 Benchmarks, and the bulk of Groks trouble is Terminal Bench 4, which uses its own miniSWE harness and is flagged as a flawed benchmark by EpochAI.
September 22, 2026 at 5:31 AM
Example problem from EpochAI FrontierMath.
epoch.ai/frontiermath...

From Wikipedia ...
"The conjecture was made by Emil Artin to Helmut Hasse on September 27, 1927, according to the latter's diary. The conjecture is still unresolved as of 2024."

We're gonna need a new frontier 🥹
December 20, 2024 at 11:55 PM
AI data centers - What you need to know #59
Series “Laboratory”
open.substack.com
November 15, 2025 at 1:25 PM
Si Frandroid et EpochAI le confirment dans une étude financée par eux-mêmes alors, c’est que ça doit être vrai …
December 12, 2025 at 10:40 AM
India is racing to become an AI superpower, but at what cost to our grid?

#AI #EnergyCrisis #India #Tech #Sustainability #DigitalIndia #MintDataBites #EpochAI
July 22, 2026 at 4:53 AM
☝️EpochAI person also does not state that the test set they showed numbers in was the mentioned blind set ... but this could be just a misshap (hopefully)
January 19, 2025 at 7:47 PM
Era de EpochAI si no recuerdo mal. 7 millones sería la capacidad de computación que tienen ahora mismo, que es muy poca comparado a lo que tienen anunciado y en construcción.
October 14, 2025 at 2:09 PM
...which would mean it should be pretty easy to estimate utilization at present, because the accounting only needs to cover big centralized blobs of compute

I wonder if the EpochAI people have looked into this
August 19, 2026 at 12:22 AM
Took 42 GWh to train GPT4 - IEA estimate ~1.7 terawatt hours to train all the large frontier models from 2020 to now.

Like with so many of the numbers in this report it's pretty big, but small on top of the denominator of 'everything'.
April 29, 2025 at 8:29 PM
Ils relaient une « étude » financée par EpochAI. Mais il est vrai que dans ce secteur, on confond souvent étude, campagne de com et étude de marché. Et que l’environnement on s’en fout comme d’une guigne
December 12, 2025 at 10:42 AM
#StargateofChina plan emerges to challenge US as #AI superpower in response to the strong lead held by the US over access to AI computing capacity. #EpochAI is estimating America has around three-quarters of the global computing power, compared to 15% in China on.ft.com/4mnJvLd via @FT #vonderLeyen
‘Stargate of China’ plan emerges to challenge US as AI superpower
Beijing increases oversight of its data centres to make better use of limited computing resources
on.ft.com
September 21, 2025 at 6:46 AM
China's top AI models are trained on American chips. Preventing China's access to top American chips prevents their access to top models.

Using EpochAI data, we found only two examples of notable models trained using Chinese chips.
June 12, 2025 at 7:11 PM
Reading the IEA's Energy and AI report

Didn't realize the energy that goes into training a mega model—they estimate the costliest model (Grok?) took 310 GWh. OTOH all models in the dataset combined cost 1.7 TWh, or 0.1% of global data center consumption over the period.
www.iea.org/reports/ener...
September 9, 2025 at 5:48 AM
Se ti sei mai imbattuto in modelli di intelligenza artificiale (IA) che sembrano risolvere problemi matematici complessi o rispondere a domande#ai #Anthropic #applicazioniIA #benchmarkIA #confrontomodelliIA #epoch #epochAI #google #GPQADiamond #IA #IAavanzata
www.corrierenerd.it/epoch-ai/
December 3, 2024 at 7:17 AM