Inference

1 long-form post on Inference: machine-learning research by Taha Bouhsine, each built around live, in-browser interactive visualizations.

1 post tagged #inference.

Aug 11, 2026

I Removed Every MLP from Gemma 4 12B

Deleting every feed-forward branch removes 8.5 billion parameters and makes local Gemma 4 inference roughly three times faster. It also turns a capable language model into a machine that emits the audio control token forever.