Associate learning for visual nonverbal and auditory verbal items was examined in 21 children with spastic diplegic cerebral palsy (SDCP) and 28 healthy children using four paired associate tasks. SDCP children showed poorer performance than the comparison group for learning pairs that required visual nonverbal responses, regardless of the stimulus modality. Within the SDCP group, lesion severity was assessed in 17 of the children. Lesion severity was related to the level of performance on paired associate tasks requiring visual nonverbal responses; lesion severity did not reach statistical significance for tasks requiring auditory verbal responses. The study suggests: (1) periventricular white matter regions are important for the development of basic learning processes, such as associative learning, and (2) learning of visual nonverbal material is disproportionately affected following white matter injury early in life.