Conditioning and Classifier-Free Guidance — How Text Steers the Image
Everything so far generates an image — any image the training distribution contains. A product needs the image you asked for. Conditioning is how a prompt gets wired into every denoising step, and classifier-free guidance — a two-line trick discovered almost apologetically — is the single knob that most determines whether the output actually obeys the prompt. The famous "CFG scale" slider in every image UI is this post.
Conditioning wires the prompt into every denoising step via text encoders and cross-attention — but the honest conditional distribution follows prompts too loosely. Classifier-free guidance fixes it: co-train an unconditional mode, then extrapolate the difference at sampling. One knob for fidelity vs diversity, 2× cost, and negative prompts for free.