On April 28, SenseTime officially released and open-sourced its SenseNova U1 series models. Based on the in-house NEO-unify architecture, the model unifies multimodal understanding, reasoning, and generation within a single model. This is a noteworthy technical-route exploration in the multimodal-model field.
Current mainstream multimodal solutions use a stitched-together architecture: vision encoder (VE) converts images to discrete tokens, VAE handles part of the visual information, finally combined with language tokens as input to the language model. Essentially, it's still a language model "seeing" visual information.
NEO-unify starts from scratch: removing the independent vision encoder and VAE, rebuilding a unified representation space from the bottom, modeling language and visual information as a unified complex directly, deeply integrating into every layer's computation. This achieves a paradigm leap from modality integration to native unification — understanding and generation are no longer split between different modules, but enhanced synchronously.
SenseTime claims SenseNova U1 is the first in the industry to achieve continuous image-text co-creation output, with a single model call generating a series of image-text content, while the traditional paradigm requires multiple calls to multiple models. With the efficiency improvement, the model can deeply understand complex layouts and fine relationships of the physical world in areas like logical reasoning and spatial intelligence. SenseTime also revealed the model will provide an embodied brain for robots in the future, completing the full closed loop from environment perception, logical reasoning, to precise execution within a single model.
SenseNova U1 is fully open-sourced, helping to lower the threshold for multimodal application development and letting more researchers participate in the verification and iteration of native unified architectures.
The NEO-unify thinking has technical insight — native unification is indeed the future direction for multimodal models, rather than bolting vision modules onto language models. But whether the radical architecture transition can bring substantive capability improvement still needs community empirical-data validation. The architecture debate of multimodal models has just begun.