What Makes a Good Latent Space? The Welch Bound and the Simplex
A visual story about the hidden codebook inside representation learning: why collapse happens, why opposition is a trap, why class means form a simplex, and why the Welch bound from radio engineering tells us the best possible geometry when too many concepts share too few dimensions.