This functional magnetic resonance imaging (fMRI) study of the mental simulation of drawing (1) investigated the neural substrates of drawing and (2) delineated the semantic aspects of drawing. The goal was to advance our understanding of how drawing a familiar object is linked to lexical semantics and therefore a viable method to use to rehabilitate aphasia. We hypothesized that the semantic aspects of drawing familiar objects compared to drawing non-objects would yield greater activation in the inferior temporal cortex and the inferior frontal cortex of the left hemisphere. To test this hypothesis, eight right-handed subjects performed an fMRI experiment that directly contrasted drawing familiar objects to non-objects using mental imagery. Simulated drawing recruited a large, distributed network of frontal, parietal, and temporal structures. In the contrast comparing drawing familiar objects to non-objects there was stronger activation in the left hemisphere within the inferior temporal, anterior inferior frontal, inferior parietal and superior frontal cortices. The activation within the inferior temporal cortex was associated with visual semantic processing and semantic mediated naming. We suggest that the anterior inferior frontal activation is linked to the inferior temporal cortex and is involved in the selection of specific semantic features of the object as well as retrieval of information regarding the perceptual aspects of the object.