See corresponding RFC for introducing a rust-based alternative front-end process in vLLM #40846. For now we have staged the poc implementation in https://github.com/Inferact/vllm-frontend-rs. This ...

The seed round values the newly formed startup at $800 million.

LLM inference engine commercialization

January 23, 2026 — Inferact, an AI startup founded by the creators of the open-source project vLLM, has officially launched after raising $150 million in seed funding, valuing the company at $800 million. The round was co-led by Andreessen Horowitz (a16z) and Lightspeed Venture Partners, with participation from Sequoia Capital, ZhenFund, and others. It ranks among the largest seed rounds ever, underscoring rapidly growing investor conviction in AI inference infrastructure as a critical layer of the AI stack.

Inferact is hiring a Founding Product Designer in San Francisco, CA United States (August 2026). OverviewInferact's mission is to grow vLLM as the world's AI inference engi

Elena Burger and Matt Bornstein are joined by Simon Mo, co-founder and CEO of Inferact, the open-source inference engine powering many of today's most advanced AI applications. Together, they explore how open-source AI evolved from a research project into critical infrastructure, why inference has become one of the most important layers of the AI stack, and what it takes to bring frontier intelligence to developers around the world. The conversation covers vLLM's origins, the rise of open-weight models, why companies increasingly want control over their AI infrastructure, and how open-source inference enables the next generation of AI applications. They also discuss model licensing, the economics of open-weight AI, Kimi K3, distillation, AI infrastructure, and why Simon believes the gap between open and closed models is rapidly disappearing.   Resources: Follow Simon Mo on X: https://x.com/simon_mo_ Follow Matt Bornstein on X: https://x.com/BornsteinMatt Follow Elena Burger on X: https://x.com/VirtualElena Follow Inferact: https://x.com/inferact Stay Updated: Find a16z on YouTube: YouTube Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg   Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.