When music generation hits the 'studio' wall

For the past two years, the hard part of music generation has never been whether a model can write a song; it has been whether a model can finish one that sounds like a real recording from start to finish.

Open any current AI music model and you keep running into the same wall: the verse is fine, then the chorus drifts out of tune; instruments enter and then quietly disappear; the emotion you set up in the first minute deflates by the middle; the chorus and the verse end up sounding like two different songs stitched together. In a sentence, these models 'generate a plausible chunk of audio,' but they have not 'realized a complete creative vision.'

On August 13, MiniMax (MiniMaxAI) pushed the weights and inference code for Music 3.0 to GitHub and Hugging Face. The repo is simply named MiniMax-AI/MiniMax-Music3, released under a Creative Commons license. At the time of writing, the GitHub repo has already collected 363 stars and 26 forks, which is a notably fast adoption pace for an open-source music model. The headline pitch is exactly aimed at that wall above: native support for full songs up to 5 minutes, with the model maintaining musical themes, rhythm, vocal identity, and arrangement progression across the whole piece.

How '5 minutes that do not fall apart' is actually built

Music 3.0 splits the full generation pipeline into three interlocking modules: Tokenizer, Hybrid-LM, and Synthesis.

The Tokenizer is 8 layers of Residual Vector Quantization (RVQ). The first layer is a semantic codebook with 16,384 entries that captures the core musical semantics and structure; the remaining 7 layers are acoustic codebooks with 1,024 entries each, filling in residual acoustic detail layer by layer. Training is two-stage too: first stabilize the first layer on its own, then jointly train all 8 layers. The result is that semantic information and acoustic detail stop fighting each other, and long-sequence prediction gets a much more stable discrete representation.

The real reason Music 3.0 can stay coherent across 5 minutes is the Hybrid-LM design:

  • An 8B Global LLM that predicts semantic tokens frame by frame and carries the whole-song context;
  • A 0.6B Local LLM that, inside each frame, predicts the acoustic tokens along the depth axis and recovers the fine-grained detail;
  • A global-alignment plus joint-training schedule: first build the Global LLM's ability to predict musical semantics, then do a full-parameter joint training pass across global and local.

The 8B Global LLM is initialized from Qwen3-8B. Its embedding and output layers are first adapted to semantic music tokens, then training continues. In other words, Music 3.0 is not training a 'song-writing LLM' from scratch; it is retraining a model that already 'knows how to write text' into one that 'knows how to write musical structure.' That is a meaningfully clever choice on data efficiency.

The final leg is Synthesis. Instead of decoding only from discrete tokens the way traditional pipelines do, it fuses the continuous hidden states from the last layers of the 8B Global LLM and the 0.6B Local LLM, feeds them into a 2.4B Flow-Matching module, and then runs a 123M Flow-VAE that inherits the MiniMax Speech architecture and is retrained for the dynamic range and spectral characteristics of music. The output is 32 kHz, 16-bit stereo WAV.

In the team's own framing, this 'LLM fused features -> Flow-Matching -> VAE hidden states -> Flow-VAE decoder -> final audio' chain lets the language model's structural understanding and the acoustic model's sound reconstruction talk to each other through continuous representations. That preserves long-range consistency while also improving articulation accuracy, instrument continuity, and fine-detail fidelity.

Two things on the input side that make it actually usable

The model takes two inputs: lyrics and a music description (a Structured Caption).

Lyrics may include explicit section tags such as [Intro], [Verse], [Pre-Chorus], [Chorus], [Post-Chorus], [Bridge], [Instrumental], [Solo], and [Outro], which set the macro skeleton. The music description further defines style, emotional arc, vocal performance, instrumentation changes, groove, low end, and spatial effects. The recommended structured three-section format is: Global Metadata (genre, sub-genre, BPM, key, emotion, use case, production profile), Vocal Details (timbre, performance style, harmony, backing vocals, vocal effects), and Arrangement (primary and secondary instruments, section-level instrument evolution, groove, bass, percussion, textures, spatial effects).

For users who do not want to write that much, the repo ships a music-caption-rewriter Skill. After
███████╗██╗ ██╗██╗██╗ ██╗ ███████╗
██╔════╝██║ ██╔╝██║██║ ██║ ██╔════╝
███████╗█████╔╝ ██║██║ ██║ ███████╗
╚════██║██╔═██╗ ██║██║ ██║ ╚════██║
███████║██║ ██╗██║███████╗███████╗███████║
╚══════╝╚═╝ ╚═╝╚═╝╚══════╝╚══════╝╚══════╝

┌ skills
│
│ Tip: use the --yes (-y) and --global (-g) flags to install without prompts.
[?25l│
◇ Source: https://github.com/MiniMax-AI/MiniMax-Music3.git
[?25h[?25l│
◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository….◐ Cloning repository….◓ Cloning repository….◑ Cloning repository….◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…..◐ Cloning repository…..◓ Cloning repository…..◑ Cloning repository…..◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…...◓ Cloning repository…...◑ Cloning repository…...◒ Cloning repository…...◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository…◓ Cloning repository…◑ Cloning repository…◒ Cloning repository…◐ Cloning repository….│
■ Failed to clone repository
│
│ Clone timed out after 300s. Common causes:
│
│ - Large repository: raise the timeout with SKILLS_CLONE_TIMEOUT_MS=600000 (10m)
│
│ - Slow network: retry, or clone manually and pass the local path to 'skills add'
│
│ - Private repo without credentials: ensure auth is configured
│
│ - For SSH: ssh-add -l (to check loaded keys)
│
│ - For HTTPS: gh auth status (if using GitHub CLI)
│
└ Installation failed

■ Canceled
[?25h, you can say something like 'make me a track in XX style' inside a supported coding agent, and the skill picks appropriate structured phrases from a built-in terminology template library and expands your one-liner into a full instruction. The skill docs are explicit that it has no external API calls and no runtime dependencies, which is friendly for local and private deployments.

The official blog post includes example prompts and full lyrics ranging from 'Classic Shanghai jazz / soul' to 'Dark E-punk hip-hop / industrial rap.' The model looks reasonably stable on both ends of that range, from Chinese songs with classical Jiangnan flavor to English tracks with cyber-club textures.

Deployment cost and current limits

Music 3.0 inference currently needs 2 CUDA GPUs:

  • GPU 0 runs Qwen3 and the 8-codebook RVQ autoregressive generation;
  • GPU 1 runs Flow Matching and DAV waveform decoding.

The team ships SGLang-Omni as the deployment entrypoint. A single brings the service up, after which you call the shared Speech API at /v1/audio/speech. The request body puts lyrics in , music description in , and at 9000 to get a complete WAV.

Hard limits called out in the repo's Limitations section: text prompt cap of 5,000 tokens, audio generation cap of 9,000 acoustic frames (corresponding to about 5 minutes maximum), non-streaming generation only at the moment, and section tags plus music descriptions provide 'generative control' rather than 'symbolic guarantees.' The generated tempo, key, instrumentation, lyrics, and structure may not always match every requested detail exactly.

Where this sits in the landscape

If you pull the timeline back to 2024 and 2025, music generation has mostly been 'closed-source hosted, API-only.' Lyria 3 Pro stretched generation to 3 minutes; Stable Audio 3.0 offered 6-minute open-source clips but with a clear gap to commercial-grade output; Magenta RealTime 2 pushed real-time generation onto a MacBook but focused on loops and sketches rather than finished songs.

What Music 3.0 delivers is not 'yet another two-verse demo.' It is a complete, transparent pipeline:

  • At the architecture level, Hybrid-LM splits 'long-range structure' and 'local detail' between two differently sized language models and stitches them back together through continuous hidden states. That is a clean example of language-model architecture thinking flowing back into music generation over the past year.
  • On data efficiency, Global LLM bootstraps from Qwen3-8B instead of training a music-specialized LLM from zero, which makes open-source reproduction realistic for small teams.
  • On creator experience, Structured Caption plus the music-caption-rewriter Skill serves both 'people who can code but not arrange' and 'people who can arrange but not code.'

Two things to watch next: first, whether vLLM or other inference frameworks add official support beyond SGLang-Omni and push the '2 CUDA GPUs' bar lower; second, whether more teams can decompose and reproduce Flow-VAE training, since a model that stably outputs 5 minutes of studio-grade audio has direct commercial landing spots in games, ads, short video, and podcasts.

For Chinese music-generation teams, Music 3.0's open release is also a clear benchmark. From RVQ codebook sizing to Hybrid-LM decomposition to Flow-VAE latent reconstruction, every key design choice is already written down in the README. That is both knowledge sharing and the starting line for the next competitive round — who can build a variant with 'better Chinese,' 'faster inference,' or 'shorter but equivalent-quality generation' on top of it will shape the next 2026 voice in this space.

Reference links: