Two experiments investigated long-term verbal memory performance in groups of 20-year-old heavy (HSDs) and light social drinkers (LSDs), in the presence and absence of a pharmacological challenge (lorazepam 2 mg). In Experiment 1 (n = 13), a verbal learning task was presented visually and it was found that lorazepam significantly impaired delayed verbal recall performance in both groups. Experiment 2 (n = 14) assessed the effect of presenting the verbal learning task in the auditory compared to the visual modality. Both groups' performance on the delayed trials of the visually presented task was reduced in the lorazepam treatment. However, in the auditory presented task, lorazepam reduced 30-min delayed recall performance in the HSDs but not in the LSDs. The differential effect of lorazepam on HSDs compared to LSDs on delayed recall performance when material is presented in the auditory modality may suggest that frequent heavy social drinking results in changes in CNS functioning.