Gemma 4 Secret MTP Discovery Sparks Developer Backlash
Is this a scandal?
No longer — the story has resolved. Noise 1/100, cooling down, across 0 sources.
Independent researchers will likely attempt to patch the Gemma 4 weights to re-enable MTP within the next few weeks. Google may face pressure to release an 'Experimental' or 'Turbo' branch of Gemma 4 that officially supports these faster inference methods.
Noise 1/100 — louder than 88% of tracked AI controversies.
Why it matters
Unexpected model capabilities in open weights releases challenge current safety evaluations, while exclusive corporate partnerships fuel distrust in AI democratization claims.
Key points
- AINews identified unexpected Multi-Token Prediction in Gemma 4 as a significant safety behavior breach on April 8.
- Gemma 4 weights leaked on Hugging Face before the scheduled April 16 official release date.
- Google allegedly fine-tuned an exclusive Gemini/Gemma variant specifically for Apple device integration.
- Community critics argue exclusive corporate partnerships undermine stated commitments to open AI development.
- Unannounced model capabilities complicate pre-release safety evaluations for open-weight architectures.
The story
Google’s release of Gemma 4 has triggered safety concerns after the model demonstrated unannounced Multi-Token Prediction (MTP) capabilities that deviate from expected behavioral baselines. AINews reported on April 8 that this feature constitutes a significant breach of anticipated AI behavior, raising questions about evaluation rigor for open-weight models. Concurrently, reports indicate Google fine-tuned a specific Gemini variant exclusively for Apple devices, prompting criticism regarding equitable access within the AI community. The model was leaked on Hugging Face prior to its official April 16 launch, complicating containment efforts. These developments highlight growing tensions between rapid open-model deployment and safety verification, as well as frustrations over perceived preferential treatment for major hardware partners in an ecosystem ostensibly committed to open research.
Who's involved
Discovered the hidden weights and expressed frustration that Google 'nerfed' the model's speed.
Argues that Google is gatekeeping performance and wants full transparency regarding model capabilities.
Maintains that removing the feature was a technical decision to ensure the model runs reliably on a wider range of consumer devices.
Noise Level
The timeline
Google confirmation reported
The developer claims a Google employee confirmed the intentional removal of MTP for compatibility reasons on a Hugging Face discussion thread.
Hidden MTP weights discovered
Reddit user Electrical-Monitor27 reports finding MTP prediction heads while debugging LiteRT on a Pixel 9.
The forecast
Independent researchers will likely attempt to patch the Gemma 4 weights to re-enable MTP within the next few weeks. Google may face pressure to release an 'Experimental' or 'Turbo' branch of Gemma 4 that officially supports these faster inference methods.
Forecast, not fact — an editorial estimate we score when this resolves.
That's the complete picture as of — nothing more to know right now. We'll update this page the moment it changes.
Join the Discussion
Discuss this story
Community comments coming in a future update
Be the first to share your perspective. Subscribe to comment.