#mlp

May 21, 2026

What an MLP Knows, When It's a Kernel

The transformer MLP is illegible because its primitive does not carry a kernel. Give it one and the four objects that make attention legible follow for free — for the whole network.