当「音乐生成」遇上「录音室」这道墙

过去两年,音乐生成模型的难点,从来不在「能不能写一首歌」,而在「能不能写完一首有头有尾、像真录音的歌」。

把现有的 AI 音乐模型打开,你会反复撞上同一堵墙:主歌写得还行,到了副歌就开始跑调;乐手进去了又消失;情绪刚铺垫起来,中段突然泄掉;副歌和主歌之间听上去像两首不同的歌拼接在了一起。一句话——它「生成了一段合理的音频」,但远远没「实现一套完整的创作构想」。

8 月 13 日,MiniMax(MiniMaxAI)正式把 Music 3.0 的权重和推理代码推上 GitHub 与 Hugging Face,仓库名就叫 MiniMax-AI/MiniMax-Music3,采用 Creative Commons 许可证。截至发稿时,GitHub 上已经攒下了 363 个 Star、26 个 Fork,在音乐生成模型里算是相当快的开源速度。这次主打的卖点,正是把上面那堵墙拆掉:模型原生支持最长 5 分钟的完整歌曲,从头到尾维持音乐主题、节奏、人声身份和编曲推进。

它到底怎么把「5 分钟不散」做出来的

Music 3.0 把整条生成链路拆成了三个互相咬合的模块:Tokenizer、Hybrid-LM 和 Synthesis。

Tokenizer 用的是 8 层残差向量量化(RVQ)。第一层是 16,384 个条目的语义码本,负责核心音乐语义和结构;剩下 7 层各 1,024 个条目的声学码本,逐层补足声学残差。训练时分两步走,先把第一层练到稳定,再联合训练全部 8 层——这样一来,语义信息和声学细节不再互相打架,长序列预测也有了更稳定的离散表示。

真正让它能跑 5 分钟不崩的,是 Hybrid-LM 设计。

  • 8B Global LLM:负责逐帧预测语义 token,负责全曲的上下文;
  • 0.6B Local LLM:在每一帧内部沿深度轴预测声学 token,补足细节;
  • 全局对齐 + 联合训练:先建立 Global LLM 对音乐语义的预测能力,再对全局与局部模型全参数联合训练。

8B Global LLM 是用 Qwen3-8B 初始化的——它的嵌入层和输出层会先适配到音乐语义 token,再投入训练。换句话说,Music 3.0 不是从零训练一个「会写歌」的大模型,而是把一个已经「会写文字」的大模型改造成「会写音乐结构」的大脑,这在数据效率上是个相当聪明的选择。

最后一棒交给 Synthesis。它不再像传统方案那样直接用离散 token 解码,而是融合 8B Global LLM 和 0.6B Local LLM 最后一层连续隐藏状态,丢给一个 2.4B Flow-Matching 模块,再串一个 123M Flow-VAE(继承自 MiniMax Speech、针对音乐动态范围重新训练)。最终输出 32 kHz、16-bit 立体声 WAV。

用官方说法,这条「LLM 融合特征 → Flow-Matching → VAE Hidden States → Flow-VAE Decoder → 最终音频」的链路,让语言模型负责的结构理解与声学模型负责的声音还原通过连续表征直接连接,在保持长程一致性的同时,进一步提升发音准确性、乐器连贯性以及细节保真度。

输入端,Music 3.0 做了两件让创作者能上手的事

模型接两个输入:歌词和音乐描述(Structured Caption)。

歌词里允许使用 [Intro]、[Verse]、[Pre-Chorus]、[Chorus]、[Post-Chorus]、[Bridge]、[Instrumental]、[Solo]、[Outro] 这种段落标签,先给定宏观骨架;音乐描述则进一步定义风格、情绪起伏、人声演绎、配器变化、律动、低频、空间效果。官方推荐的结构化描述三段式是:Global Metadata(流派、子流派、BPM、调性、情绪、场景、制作质感)、Vocal Details(音色、唱法、和声、人声效果)、Arrangement(主辅乐器、段落级乐器演化、律动、低频、打击乐、空间)。

如果你懒得写这么细,仓库里直接附了一个 music-caption-rewriter Skill,通过
███████╗██╗ ██╗██╗██╗ ██╗ ███████╗
██╔════╝██║ ██╔╝██║██║ ██║ ██╔════╝
███████╗█████╔╝ ██║██║ ██║ ███████╗
╚════██║██╔═██╗ ██║██║ ██║ ╚════██║
███████║██║ ██╗██║███████╗███████╗███████║
╚══════╝╚═╝ ╚═╝╚═╝╚══════╝╚══════╝╚══════╝

┌ skills
│
│ Tip: use the --yes (-y) and --global (-g) flags to install without prompts.
[?25l│
◇ Source: https://github.com/MiniMax-AI/MiniMax-Music3.git
[?25h[?25l│
◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...│
■ Failed to clone repository
│
│ Failed to clone https://github.com/MiniMax-AI/MiniMax-Music3.git: Cloning into '/var/folders/80/3591fxss0qg5dky7mp8xlpq80000gn/T/skills-gJsixz'...
│
│ fatal: unable to access 'https://github.com/MiniMax-AI/MiniMax-Music3.git/': Failed to connect to github.com port 443 after 75002 ms: Couldn't connect to server
│
│
│
└ Installation failed

■ Canceled
[?25h 安装后,在支持的 coding agent 里一句「帮我做一首 XX 风格的歌」,它就会从内置的术语模板库里挑出合适的结构化表达,把你的一句话扩展成完整指令。技能说明里特别提到,它不依赖外部 API,也不带运行时依赖,适合本地化、私有化部署。

官方文章里给出了从「Classic Shanghai jazz / soul」到「Dark E-punk hip-hop / industrial rap」一系列示例 prompt 和完整歌词,可以看到模型在「中文歌配古典江南气质」与「英文歌配赛博俱乐部质感」两端都跑得相对稳定。

部署成本和限制

Music 3.0 目前的推理需要 2 张 CUDA GPU:

  • GPU 0:跑 Qwen3 和 8 码本 RVQ 的自回归生成;
  • GPU 1:跑 Flow Matching 和 DAV 波形解码。

官方提供 SGLang-Omni 作为部署入口,一条 就能起服务,然后通过共享的 Speech API(/v1/audio/speech)调用。请求体里把歌词塞进 input、音乐描述塞进 instructions、max_new_tokens 设到 9000 就能拿到一段完整 WAV。

需要注意的边界:仓库 Limitations 部分明确写了——文本 prompt 上限 5,000 tokens、音频生成上限 9,000 acoustic 帧(对应最长约 5 分钟)、目前只支持非流式输出、段落标签和音乐描述提供的是「生成式控制」而非「符号级保证」,生成的 tempo、key、配器、歌词和结构不一定每一项都和请求严格对齐。

它现在所处的位置

如果把时间线拉回 2024 到 2025 年,音乐生成赛道的玩法一直是「闭源托管 + API 调用」。Lyria 3 Pro 把生成拉到 3 分钟;Stable Audio 3.0 把开源 6 分钟一首拿出来,但生成质量与商用级仍有距离;Magenta RealTime 2 把实时生成塞进 MacBook,但聚焦的是 loop 和 sketch,不是成品歌。

Music 3.0 这次给出的,不是「又一个能唱两段的 Demo」,而是一套完整的、从架构到部署都对开发者透明的方案:

  • 架构层面:Hybrid-LM 把「长程结构」和「局部细节」拆给两个不同规模的语言模型,再用连续隐藏状态把二者缝合——这是过去一年语言模型架构思想反向流入音乐生成的一个典型样本。
  • 数据效率:Global LLM 借力 Qwen3-8B 初始化,避免从头训练一个音乐专用大模型,这对中小团队的开源复现非常友好。
  • 创作者体验:Structured Caption + music-caption-rewriter Skill,把「会写代码不会写编曲」的人和「会写编曲不会写代码」的人都接住了。

接下来值得关注的是两件事:第一,SGLang-Omni 之外是否会出现 vLLM 或其它推理框架的官方支持,把「2 张 CUDA GPU」的部署门槛进一步下压;第二,Flow-VAE 的训练成本是否会被更多团队拆解复现,毕竟一个能稳定输出 5 分钟录音室级音频的生成模型,在游戏、广告、短视频、播客这些场景里都有相当直接的落地空间。

对国内做音乐生成的团队而言,MiniMax Music 3.0 的开源也提供了一个清晰的对照点:从 RVQ 码本规模、Hybrid-LM 拆分、到 Flow-VAE 的隐空间重建,整条链路里的每一个关键设计都已经写在 README 里。这既是知识共享,也是下一轮竞争的起跑线——能不能在它基础上做出「中文场景更好」「推理更快」「生成时长更短但质量相当」的变体,会决定 2026 下半年音乐生成这条赛道的话语权分配。

参考链接: