During silent reading, visual information provided by letters is converted to auditory information in the mind. The purpose of this study was to identify the primary locus for auditory verbal imagery in the brain. Neuromagnetic recording was obtained from 10 right-handed study participants, who were instructed to identify infrequently occurring phonological mismatches between a random-ordered sequence of syllable sounds and a visually presented syllabogram sequence. The activity difference in early latency, calculated by subtracting the averaged responses to matched syllables from the averaged responses to mismatched syllables, showed a spatiotemporal profile strikingly similar to that of mismatch negativity. Auditory imagery of forthcoming verbal sounds may establish a memory trace as a template for imagery-based mismatch negativity generation in the auditory cortex.