In this fMRI study, we aimed at identifying the cortical areas engaged in supramodal processing of language comprehension. BOLD changes were recorded in 19 healthy right-handed subjects reading or listening to a story. During the visual control tasks the volunteers attended to a series of continuous letterstrings or a fixation cross, while during the acoustic control tasks either a reversed text or white noise were presented. The conjunction of the visual and acoustic story processing yielded left-dominant activations which in comparison to language-like stimuli focused to the left middle temporal gyrus as well as to the supramarginal gyrus. We conclude that the core structure representing supramodal language comprehension is the left temporal lobe at both banks of the superior temporal sulcus.