#OpenAI’s #Jalapeño, a self-designed #ASIC for #LLMinference, outperforms #Nvidia’s #Blackwell and other competitors in #tokenthroughput per watt. Built with Broadcom, the chip uses HBM4 memory and a generalised architecture, excelling in both low-latency and high-throughput scenarios. While comparisons to Blackwell are incomplete, Jalapeño’s performance against Vera Rubin, which also uses HBM4, is noteworthy. https://newsletter.semianalysis.com/p/openai-jalapeno-better-than-nvidia?eicker.news #tech #news #ainews