#information-theory

Feb 22, 2026

Not All Infinities Are Equal

The singularity structure of cross-entropy explains hallucination, the modality gap, and why contrastive losses need such big batches.