Abnormalities in the interactions between functionally linked brain regions have been suggested to be associated with the clinical impairments observed in autism spectrum disorders (ASD). We investigated functional connectivity within the limbic system during face identification; a primary component of social cognition, in 19 high-functioning adults with ASD and 21 age-and IQ-matched control adults. Activation during identification of previously viewed faces and houses using a one-back paradigm was compared. The fusiform face area (FFA) was individually localized in each participant and used as the seed point for functional connectivity analyses. The degree of correlation between FFA and the extended neural circuitry involved in face identification was tested. A whole brain analysis was also conducted in order to determine whether connectivity from the FFA to aberrant brain locations was present in the ASD group. Measures of clinical severity (ADOS social score and ADI-R social score) were included as independent variables into the functional connectivity analyses. Significant FFA-amygdala and FFA-superior temporal sulcus functional connectivity was found in both the ASD and control participants. However, the control group had significantly increased connectivity to the left amygdala and the posterior cingulate compared to ASD. Post hoc analyses additionally found increased connectivity to the thalamus in the controls. A significant relationship between abnormal functional connectivity and clinical severity in the ASD group was observed. Specifically, greater social impairment was associated with reduced FFA-amygdala connectivity and increased FFA-right inferior frontal connectivity. These results suggest that abnormal neural connections within the limbic system may contribute to the social impairments observed in ASD.