Under conditions of inattention or deficits in orienting attention, special classes of stimuli (e.g. faces, bodies) are more likely to be perceived than other stimuli. This suggests that biologically salient visual stimuli automatically recruit attention, even when they are task-irrelevant or ignored. Here we report results from a behavioral experiment with female and male subjects and two magnetoencephalography (MEG) experiments with male subjects only, in which we investigated attentional capture with face and hand stimuli. In both the behavioral and MEG experiments, subjects were required to count the number of gender-specific targets from either face or hand categories within a block of stimuli. In the behavioral experiment, we found that male subjects were significantly more accurate in response to female than male face target blocks. There was no corresponding effect found in response to hand target blocks. Female subjects did not show a gender-based difference in response to face or hand target blocks. MEG results indicated that the male subjects' responses to face stimuli in primary visual cortex (V1) and the face-selective part of the fusiform gyrus (FG) were reduced when male face stimuli were not relevant to the task, whereas female faces maintained a strong response in these areas in both task-relevant and task-irrelevant conditions. These results suggest that within the male brain, female face stimuli are more resilient to suppression than male faces, once attention is drawn to the part of the visual field where the face appears.