[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"news-a151db0c-d832-4df2-ac03-2d4e58b26e99":3},{"id":4,"title":5,"summary":6,"original_url":7,"source_id":8,"tags":9,"published_at":32,"created_at":33,"modified_at":34,"is_published":35,"publish_type":36,"image_url":13,"view_count":37},"a151db0c-d832-4df2-ac03-2d4e58b26e99","Kimi K3 跑通 MiniTriton:Moonshot 让 LLM 第一次从零编译出自己的 GPU 编译器","Moonshot 在 Kimi K3 技术博客里把 LLM 的 agentic 能力直接推到了系统软件层级:模型不只在 benchmark 上和 Fable 5、GPT 5.6 Sol 贴身竞争,它真的在 sandbox 里连续 24 小时 profile、重写并 benchmark 了四个 GPU kernel 任务,在 AttnRes、KDA 和一个 512 维头部的 MLA kernel 上和 Fable 5 持平、显著压过 Opus 4.8、GPT 5.5 和 5.6 Sol。更有杀伤力的是另一个 case:K3 自己写出了一个 Triton-like 编译器 MiniTriton,带上自研的 tile-level IR、MLIR 之上的优化通道和 PTX 代码生成 pipeline,在多组 roofline benchmark 上和 Triton、torch.compile 互有胜负,还能稳定跑完 nanoGPT 端到端训练,loss 曲线几乎贴着参考实现走。K3 的架构骨架是 Kimi Delta Attention(线性注意力)+ Attention Residuals(跨层残差)+ Stable LatentMoE(896 选 16),搭配 SiTU 激活和 Gated MLA,官方给出的 scaling efficiency 比 K2 提升约 2.5 倍,2.8 万亿参数全部由 MXFP4 权重 + MXFP8 激活训出来,服务侧则依赖 64 卡以上的 supernode 配置才跑得动。技术报告还没发,论文里承诺的细节要等 7 月 27 日权重开源一起落地。问题是这些 case 都跑在 Moonshot 自家 sandbox 里,能不能复现还得等社区下场——但把「自己写编译器」写进 model card 这一步,确实把 agentic benchmark 的天花板往上抬了一截。","https:\u002F\u002Fwww.kimi.com\u002Fblog\u002Fkimi-k3","0ec8f614-42c7-4256-8591-209e1e39eb6b",[10,14,17,20,23,26,29],{"id":11,"name":12,"slug":12,"description":13,"color":13},"7ac06d8e-b074-4147-abfc-ffaa4c6b8744","ai-efficiency",null,{"id":15,"name":16,"slug":16,"description":13,"color":13},"a8002d98-9df1-4ab9-94d4-a7625af634c4","china-ai",{"id":18,"name":19,"slug":19,"description":13,"color":13},"01598627-1ea6-4b27-a5d8-874971571a71","llm",{"id":21,"name":22,"slug":22,"description":13,"color":13},"7e89b5cc-57db-4f37-bc6d-28919a73931c","model-release",{"id":24,"name":25,"slug":25,"description":13,"color":13},"499f4b56-819d-49a3-9609-33e775143b86","multimodal",{"id":27,"name":28,"slug":28,"description":13,"color":13},"b9bd9039-fcdb-41a8-b85b-fc1587def2b9","open-source",{"id":30,"name":31,"slug":31,"description":13,"color":13},"4f214978-cac1-4f39-aa4b-f92a0d0934b7","transformer","2026-07-26T14:00:00Z","2026-07-26T10:03:43.050611Z","2026-07-26T10:03:43.050619Z",true,"agent",1]