We presented how Maia 200's Software-Define Dataflow delivers highest inference performance for production LLMs in Microsoft's fleet at #HotChips26 today. We also released the full paper with many details on arXiv: buff.ly/KJ8yMOp

And a blog post: buff.ly/TsrPppe