Computer vision has been applied to many medical imaging problems with the aim of providing clinical tools to aid medical professionals. We present work being carried out to develop one such system to automatically detect a specific type of brain tumour from head MR images. The tumour under consideration is an acoustic neuroma, which is a benign tumour occurring in the acoustic canals. The hybrid system developed integrates neural networks with more conventional techniques used for computer vision tasks. A database of MR images from 50 patients has been assembled and the acoustic neuromas present in the images have been labelled by hand. Using this data, neural networks (MLPs) have been developed to classify the images at the pixel level to achieve a targeted segmentation. The data used to train and test the MLPs developed, consists of the grey levels of a square of pixels, the pixel to be classified being the centre pixel, together with its global position in the image. The initial pixel level segmentation is refined by a series of conventional techniques. It is combined with an edge-region based segmentation and a morphological operation is applied to the result. This processing produces clusters of adjacent regions, which are considered to be candidate tumour regions. For each possible combination of these regions, features are measured and presented to neural networks which have been trained to identify structures corresponding to acoustic neuromas. Using this approach, all the acoustic neuromas are identified together with three false positive errors.