arXiv 2606.04847 introduces MusaCoder, an open-source kernel generation model trained entirely on Moore Threads' domestic GPU stack. The standout: MusaCoder hits SOTA on KernelBench (a kernel generation benchmark), and the entire training pipeline (model, data, training, evaluation) is run on domestic GPU.
The "all-stack domestic GPU" highlight: most "AI for chip design" research is trained on NVIDIA GPUs. MusaCoder is the first kernel generation model trained end-to-end on domestic GPU (Moore Threads' MTT S5000). The training pipeline is fully documented and reproducible, and the result is competitive with NVIDIA-trained models.
The KernelBench SOTA: on the KernelBench benchmark (kernel generation for various hardware), MusaCoder hits SOTA — beating previous models that were trained on NVIDIA. The "all-stack domestic GPU" achievement is the first of its kind, and it demonstrates that domestic GPU is now capable of training state-of-the-art AI models.
The technical details: MusaCoder is a 7B-parameter LLM fine-tuned for kernel generation. The training data is a curated dataset of (problem description, reference kernel, optimized kernel) triples. The model is trained with a combination of SFT and RL, with the reward being the kernel's correctness and performance.
The "AI for chip design" angle: kernel generation is a key use case for "AI for chip design" — i.e., using AI to help design and optimize chips. MusaCoder is specifically targeted at the Chinese AI chip ecosystem, where "AI for chip design" is needed to optimize the growing number of domestic AI chips.
The bigger takeaway: "domestic AI for chip design" is becoming a real capability. The "all-stack NVIDIA" assumption is breaking, and the "domestic GPU + domestic AI for domestic chip design" approach is a self-reinforcing flywheel. For the industry, this signals that "domestic AI infrastructure" is increasingly self-sufficient, and the "AI for chip design" market will see significant domestic competition.