Face perception and emotion recognition have been extensively studied in the past decade; however, the relation between them is still poorly understood. A traditional view is that successful emotional categorization requires categorization of the stimulus as a 'face', at least at the basic level. Here we tested whether emotional information could still be recognized accurately without explicit categorization of a stimulus as a face. For this purpose we created a stimulus set in which facial stimuli expressing a range of happy-to-fear emotions were morphed into another object category (shoe). Interestingly, participants categorized emotions with great accuracy in stimuli that contained so little face information that they were explicitly categorized as shoes. Hence, our results show that accurate emotion categorization can take place in stimuli that contain surprisingly little face information. This finding raises interesting questions about the extent to which processes leading to emotion recognition and categorical face perception might be separable.