Neural Networks

1 long-form post on Neural Networks: machine-learning research by Taha Bouhsine, each built around live, in-browser interactive visualizations.

1 post tagged #neural-networks.

Feb 20, 2026

What Activations Do to Geometry

ReLU, GELU, and their relatives enter a layer's Jacobian as an input-dependent row scaling. Here is when that scaling erases directions, when it merely distorts them, and what the usual repairs actually guarantee.