Learning associations between people's faces and names is a universal cognitive function with important social implications. The goal of the present study was to examine brain activity patterns associated with cross-modal encoding of names and faces. Learning face-name pairs was compared to unimodal learning tasks using the same visual and auditory stimuli. Spatiotemporal brain activation profiles were obtained with magnetoencephalography using an automated source estimation method. Results showed activation foci in left (for names) and right (for faces) temporal lobe perisylvian cortices, predominantly right-hemisphere occipital and occipitotemporal regions (for faces), and right hemisphere dorsolateral prefrontal regions during the encoding phase for both types of stimuli presented in isolation. Paired (face-name) stimulus presentation elicited bilateral prefrontal and temporal lobe perisylvian activity for faces and enhanced visual cortex activation in response to names (compared to names in the unpaired condition). These findings indicate distinct patterns of brain activation during the formation of associations between meaningful visual and auditory stimuli.