Hugging Face and Intel released the xpu-kernels Skill, an LLM Agent that automatically optimizes vLLM's Triton kernels for Intel GPUs. The result: 2.8× speedup on Intel Gaudi 3 and Intel Max GPUs, with no quality loss.
The "Agent-driven kernel optimization" pattern: the xpu-kernels Skill is an LLM Agent that takes a Triton kernel and a target Intel GPU, and outputs an optimized version of the kernel. The Agent uses a combination of code generation, profiling, and iterative optimization to find the best kernel configuration.
The benchmark: on a set of 50 popular Triton kernels (used in vLLM, SGLang, etc.), the xpu-kernels Skill hits an average 2.8× speedup on Intel Gaudi 3. The biggest improvement is on attention kernels (3.5×), and the smallest is on simple elementwise kernels (1.4×).
The "AI optimizes AI" angle: the xpu-kernels Skill is an example of "AI for AI infrastructure" — using LLMs to optimize the systems that run LLMs. The same Agent can be used to optimize kernels for any hardware (AMD, Intel, NVIDIA, custom accelerators), and the optimization time is a few minutes per kernel, vs hours for human experts.
The bigger takeaway: "Agent-driven optimization" is the future of AI infrastructure. The traditional "human expert writes kernels" approach is too slow and too expensive, and the "AI Agent writes kernels" approach is significantly faster and can match expert quality. For the industry, this means "AI infrastructure" will be increasingly built by AI, not by humans.