We tested the magnitude of the face identity aftereffect following adaptation to different modes of adaptors in four experiments. The perceptual midpoint between two morphed famous faces was measured pre- and post-adaptation. Significant aftereffects were observed for visual (faces) and nonvisual adaptors (voices and names) but not nonspecific semantic information (e.g., occupations). Aftereffects were also observed following imagination and adaptation to an associated person. The strongest aftereffects were found adapting to facial caricatures. These results are discussed in terms of cross-modal adaptation occurring at various loci within the face-recognition system analogous to priming.