Intel Inference Microservices Bring Tuned LLMs to Xeon Intel has announced Intel Inference Microservices, a set of containerized services for large language model inference. The goal is simple. Businesses can now get tuned model inference on the Xeon processors they already own. They no longer need to spend days on manual hardware optimization. How the Containers Work Each microservice is a standalone container.