Server maker will initially purchase 10,000 SN50 chips from SambaNova

SambaNova SN50 llega a los racks de Supermicro: 10.000 chips RDU para escribir la respuesta, junto a GPU de Nvidia.

Supermicro reported fiscal first quarter revenue of $19.95 billion and announced a strategic partnership with SambaNova to develop AI inference systems.

Supermicro will build and sell AI inference systems pairing SambaNova SN50 chips with Nvidia GPUs, according to the companies.Source: The Next Webhttps://thenextweb.com/news/supermicro-sambanova-sn50-nvidia-inference-racks#AI #Nvidia

Bengaluru, Karnataka, India · Incident-response in the stack. Put this near the top of the list.

SambaNova announced a collaboration with Supermicro on November 3 to develop and sell inference systems combining NVIDIA GPUs with SambaNova SN50 Reconfigurable Dataflow Units, or RDUs. The companies are initially planning for 10,000 SN50 chips. That is a planning figure, with no corresponding installed capacity established by the announcement. The primary announcement describes GPUs handling prefill, the processing of an input prompt, and RDUs handling decode, the generation of the response. Supermicro will integrate, test, deliver and support the systems, including on-site service. SambaNova engineers will tune models on SN50 and assist deployments. For infrastructure teams, my reading is that the integration between those stages deserves as much scrutiny as either accelerator. A proposed acceptance test should follow a request across the whole system, including waiting, data transfer and recovery. ## Establish what the deployment offer includes The new development is the commercial collaboration and planned systems. The release gives no detailed rack configuration, price or specific shipping date for the Supermicro offering. Before reserving facility space, ask for the supported configuration and its delivery assumptions. Request the model list, software versions, network requirements, power envelope and cooling interfaces for the system being quoted. Keep the bill of materials attached to the test results. If a supplier changes a network component or software release, establish whether the previous acceptance evidence still applies. That creates a practical link between what was demonstrated and what arrives at the loading dock. ## Measure the request across both stages My recommendation is to make end-to-end latency the starting point for evaluation. For a representative workload, record when the request arrives, when prefill begins and ends, when decode becomes ready and when the user receives the first output. Continue measuring through completion. Ask the supplier which timestamps come from a shared clock and how the measurements can be correlated. Then vary the workload deliberately. Use the prompt lengths, response lengths and concurrency expected in production. Include the busy periods during which requests wait before reaching an accelerator. This is a proposed test plan, not a measured result from the collaboration. Its purpose is to show where the combined system spends time. A fast stage can still leave users waiting elsewhere in the request path. ## Ask how the stages are balanced A heterogeneous system introduces a capacity-planning question: how much of each resource does the intended workload need? Have the supplier explain the sizing assumptions and demonstrate what happens when the request mix changes. Test whether longer prompts alter the queue before generation, and whether longer responses constrain the resources serving subsequent requests. Watch both queues and accelerator utilization together. Record any admission controls that keep the system within the agreed service target. Confirm who can change those controls and what evidence triggers a change. The useful output is a supported operating range for the combined service. That gives the scheduling team something concrete to use when deciding which workloads to admit. ## Follow state and failures through the handoff The boundary between prefill and decode also needs an operational walkthrough. Ask what state crosses that boundary, where it is stored, how long it remains available and how it is protected. Request an explanation of what happens if a destination becomes unavailable after the first stage finishes. In a controlled acceptance exercise, interrupt a component on that path and observe the response. Determine whether the request retries, restarts, fails visibly or waits for recovery. Check what the client sees and whether the operator can identify the affected stage. Keep the exercise tied to the actual proposed implementation. The announcement does not specify these recovery behaviors, so buyers need evidence for the configuration they intend to operate. ## Make support ownership usable during an incident The stated division of support responsibilities is helpful. Turn it into a procedure the operations team can follow. Agree on the first contact, the logs needed for escalation and ownership of issues that span model tuning, system software and physical hardware. Run through a case in which each subsystem appears healthy but the service misses its latency target. For an infrastructure buyer, the next useful milestone is a documented demonstration of the quoted system under a relevant workload. Combine that evidence with facility requirements, delivery terms and a workable escalation path before making production commitments.

Austin, Texas, United States; San Jose, California, United States · Incident-response in the stack. Straight up one of the good ones.

Austin, Texas, United States; San Jose, California, United States · Platform in the stack. Cleared the bar without trying.

Reported Tuesday, Nov 3 - 9:09am EST (TheFly subscription required to read more.)

Stock Titan provides an ultra-fast stock market news feed and multiple tools for traders and investors.

Supermicro will build, sell and support SambaNova SN50 inference systems paired with NVIDIA GPUs, starting with neoclouds. The Nov. 3 release gives no rack power, cooling, price or ship date.

SambaNova’s CEO says agentic AI ‘has to run everywhere’. Supermicro will now sell its SN50 chips next to Nvidia GPUs, starting with 10,000.

PNAU's 1999-ish album Sambanova exists in several different versions. I've had a longtime quest to acquire the three major versions of the album, because they each contain different material, confusin...

SambaNova Systems closed a $1 billion Series F at an $11 billion valuation in July 2026, then spent the following weeks announcing the partnerships that explain why: two deals in three days that refr…

30 días de datos reales de Groq, Cerebras, SambaNova y 43 proveedores más muestran que la latencia cambia hasta 15 veces según la región desde donde consultás