@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
Zain- Coding Agents
Sreekanth- Human Collaboration
Naveen- Deep Research to Prometheus
Jay- Service as a Software solutions
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
Zain- Coding Agents
Sreekanth- Human Collaboration
Naveen- Deep Research to Prometheus
Jay- Service as a Software solutions
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
14 sessions on:
→ AI benchmarking
→ Agentic evaluation
→ Token economics
→ Safety & risk
→ Data quality
Valuable content if you're working on AI deployment, benchmarking, or safety.
Full playlist: https://bit.ly/4jYqlfw
#Endpoints2025 #MLCommons
14 sessions on:
→ AI benchmarking
→ Agentic evaluation
→ Token economics
→ Safety & risk
→ Data quality
Valuable content if you're working on AI deployment, benchmarking, or safety.
Full playlist: https://bit.ly/4jYqlfw
#Endpoints2025 #MLCommons
@dkanter.bsky.social
#MLCommons #Endpoints2025
@dkanter.bsky.social
#MLCommons #Endpoints2025
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
They happen when researchers + practitioners + industry leaders are in the same room, working on shared challenges.
MLCommons Endpoints
Dec 1, San Diego (one day!)
Registration ↓
www.eventbrite.com/e/mlcommons-...
#Endpoints2025
They happen when researchers + practitioners + industry leaders are in the same room, working on shared challenges.
MLCommons Endpoints
Dec 1, San Diego (one day!)
Registration ↓
www.eventbrite.com/e/mlcommons-...
#Endpoints2025
Scaling AI is all about the:
Tokens per dollar per Watt curve.
Right now the biggest bottleneck is memory and next is energy.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
Scaling AI is all about the:
Tokens per dollar per Watt curve.
Right now the biggest bottleneck is memory and next is energy.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
Deep dive on efficiency across the AI stack:
→ Token production
→ Model optimization
→ Deployment efficiency
Watch: https://bit.ly/46lhTBm
Michael Stewart (M12), Zain Asgar (Gimlet Labs), S. Annapureddy (Netradyne), Naveen Rao (UnconventionalAI), Jay Ram (Hud)
Deep dive on efficiency across the AI stack:
→ Token production
→ Model optimization
→ Deployment efficiency
Watch: https://bit.ly/46lhTBm
Michael Stewart (M12), Zain Asgar (Gimlet Labs), S. Annapureddy (Netradyne), Naveen Rao (UnconventionalAI), Jay Ram (Hud)
Most benchmarks are too narrow. This is how we fix that.
Watch: https://bit.ly/4bAomff
#Endpoints2025 #MultilingualAI
Most benchmarks are too narrow. This is how we fix that.
Watch: https://bit.ly/4bAomff
#Endpoints2025 #MultilingualAI
Luis Oala on the economics that matter:
→ Data flywheels
→ Token efficiency
→ Compounding advantages
→ Sustainable growth
Watch: https://youtu.be/a8psNW72l3Q
#Endpoints2025 #AIEconomy
Luis Oala on the economics that matter:
→ Data flywheels
→ Token efficiency
→ Compounding advantages
→ Sustainable growth
Watch: https://youtu.be/a8psNW72l3Q
#Endpoints2025 #AIEconomy
Panel on measuring what can go wrong with AI systems.
Beyond accuracy → comprehensive risk assessment.
Watch: https://youtu.be/UgETTwnz6kY
#Endpoints2025 #AIReliability
Panel on measuring what can go wrong with AI systems.
Beyond accuracy → comprehensive risk assessment.
Watch: https://youtu.be/UgETTwnz6kY
#Endpoints2025 #AIReliability
Sean McGregor on the challenge:
- We need agents
- We need benchmarks
- We need products
- We need all three NOW
How do we do this responsibly?
Watch: https://youtu.be/PriW3_kaxLA
#Endpoints2025 #AIAgents
Sean McGregor on the challenge:
- We need agents
- We need benchmarks
- We need products
- We need all three NOW
How do we do this responsibly?
Watch: https://youtu.be/PriW3_kaxLA
#Endpoints2025 #AIAgents
David Kanter on how we move fast AND build trust.
Spoiler: It's not either/or. Benchmarking enables both.
Watch: https://youtu.be/RkaApbTsNMc?si=FY6VbfUS74LY1N2v
#Endpoints2025 #MLCommons
David Kanter on how we move fast AND build trust.
Spoiler: It's not either/or. Benchmarking enables both.
Watch: https://youtu.be/RkaApbTsNMc?si=FY6VbfUS74LY1N2v
#Endpoints2025 #MLCommons
This was genuinely one of the best AI events of the year - really practical, substantive discussions about benchmarking, deployment, safety, and economics.
https://bit.ly/4jYqlfw
#Endpoints2025
This was genuinely one of the best AI events of the year - really practical, substantive discussions about benchmarking, deployment, safety, and economics.
https://bit.ly/4jYqlfw
#Endpoints2025
AI is so disruptive and evolving in a way that's so different than we thought it would it requires us to think about the future differently.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
AI is so disruptive and evolving in a way that's so different than we thought it would it requires us to think about the future differently.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025
@mlcommoms.org
#MLCommons #Endpoints2025
@mlcommoms.org
#MLCommons #Endpoints2025
Luis Oala Co-Founder and Chief AI Officer w/ Brickroad brickroadapp.com
@mlcommoms.org
#MLCommons #Endpoints2025
Luis Oala Co-Founder and Chief AI Officer w/ Brickroad brickroadapp.com
@mlcommoms.org
#MLCommons #Endpoints2025
Deepak Nathani- @dnathani.bsky.social
My question:
Are you seeing any personal AI solutions that would allow greater control over our information instead of giving it all to a foundation model LLM?
@mlcommoms.org
#MLCommons #Endpoints2025
Deepak Nathani- @dnathani.bsky.social
My question:
Are you seeing any personal AI solutions that would allow greater control over our information instead of giving it all to a foundation model LLM?
@mlcommoms.org
#MLCommons #Endpoints2025
@dkanter.bsky.social w/ @mlcommoms.org view on the velocity of LLM model releases.
TLDR: The pace is incredible and only increasing.
#MLCommons #Endpoints2025
@dkanter.bsky.social w/ @mlcommoms.org view on the velocity of LLM model releases.
TLDR: The pace is incredible and only increasing.
#MLCommons #Endpoints2025
#MLCommons #Endpoints2025
#MLCommons #Endpoints2025
www.eventbrite.com/e/mlcommons-...
#MLCommons #Endpoints2025
www.eventbrite.com/e/mlcommons-...
#MLCommons #Endpoints2025