It has been suggested that the mental construction of scene imagery is a core process underpinning functions such as autobiographical memory, future thinking and spatial navigation. Damage to the ventromedial prefrontal cortex in humans can cause deficits in all of these cognitive domains. Moreover, it has also been reported that patients with ventromedial prefrontal cortex lesions are impaired at imagining fictitious scenes, although they seem able to describe specific scenes from autobiographical events. In general, not much is known about how ventromedial prefrontal cortex patients process scenes. Here, we deployed a recently-developed task to provide insights into this issue, which involved detecting either semantic (e.g. an elephant with butterflies for ears) or constructive (e.g. an endless staircase) violations in scene images. Identifying constructive violations typically provokes the formation of internal scene models in healthy control participants. We tested patients with bilateral ventromedial prefrontal cortex damage, brain-damaged control patients and healthy control participants. We found no evidence for statistically significant differences between the groups in detecting either type of violation. These results suggest that an intact ventromedial prefrontal cortex is not necessary for some aspects of scene processing, with implications for understanding its role in functions such as autobiographical memory and future thinking.