The human cortical visual system is organized into major pathways: a dorsal stream projecting to the superior parietal lobe (SPL), considered to be critical for visuospatial perception or on-line control of visually guided movements, and a ventral stream leading to the inferotemporal cortex, mediating object perception. Between these structures lies a large region, consisting of the inferior parietal lobe (IPL) and superior temporal gyrus (STG), the function of which is controversial. Lesions here can lead to spatial neglect, a condition associated with abnormal visuospatial perception as well as impaired visually guided movements, suggesting that the IPL+STG may have largely a "dorsal" role. Here, we use a nonspatial task to examine the deployment of visuotemporal attention in focal lesion patients, with or without spatial neglect. We show that, regardless of the presence of neglect, damage to the IPL+STG leads to a more prolonged deployment of visuotemporal attention compared to lesions of the SPL. Our findings suggest that the human IPL+STG makes an important contribution to nonspatial perception, and this is consistent with a role that is neither strictly "dorsal" nor "ventral". We propose instead that the IPL+STG has a top-down control role, contributing to the functions of both dorsal and ventral visual systems.