Linear Structure of High-Level Concepts in Text-Controlled Generative Models

Text controlled generative models (such as large language models or text-to-image diffusion models) operate by embedding natural language into a vector representation, then using this representation to sample from the model’s output space. This talk concerns how high-level semantics are encoded in the algebraic structure of representations.