Google AI Blog released Gemma 4 QAT (Quantization-Aware Training), a method that produces highly compressed Gemma 4 models with quality preserved. The standout: the E2B (effectively 2B) variant can run in 1GB of memory — small enough to fit on a Raspberry Pi, a low-end Android phone, or a browser.
The "training-time quantization" highlight: QAT trains the model with the quantization in the loop, so the model learns to compensate for the quantization noise. The result is a model that is significantly more accurate than post-training quantization (PTQ) at the same bit width. Gemma 4 QAT-INT4 is within 1 point of the FP16 baseline, while PTQ-INT4 is 4-5 points behind.
The "1GB memory" achievement: a 1GB model is small enough to run on a wide range of devices. The Gemma 4 QAT-E2B-INT4 model achieves this with no quality loss on the standard Gemma 4 benchmark suite. This is the first time a "frontier-quality" model has been compressed to 1GB.
The "consumer-grade AI" angle: 1GB is the threshold for "consumer-grade AI" — the model can run on a phone without dedicated AI hardware, on a browser via WebAssembly, or on a $50 single-board computer. The implication: every consumer device can now run a frontier-quality LLM locally, without sending data to the cloud.
The bigger takeaway: "1GB frontier model" is a major milestone for on-device AI. The "frontier model needs 100GB+ of VRAM" assumption is breaking, and the "consumer-grade AI" era is beginning. For the industry, this means on-device AI will become the default for privacy-sensitive and low-latency use cases, and the cloud AI vendors will need to compete on capabilities that on-device AI cannot easily replicate.