While the effect of listening to music on cognitive abilities is highly debated, studies reporting an enhancing effect of music in elderly populations appear to be more consistent. In this study, the effects of listening to music on attention in groups of cognitively normal older adults and those with mild cognitive impairment were considered. Participants were exposed to both a music and silence condition, and after each condition performed Digit Span and Coding tasks which require attention for maximal performance. The hypothesis that listening to music, compared to a silence condition, enhances performance was not supported for either group. Various explanations for these findings are considered.