Human vision adapts to the contrast of patterns by changing its sensitivity, but the origins of this perceptual adaptation have been disputed. In this issue of Neuron, Solomon et al. show that contrast adaptation in the primate arises mostly in the retina for the magnocellular pathway and mostly in the cortex for the parvocellular pathway. It appears that adaptation arises most strongly at sites that pool over many inputs.