Here, we review recent results that investigate the development of the human ventral stream from childhood, through adolescence and into adulthood. Converging evidence suggests a differential developmental trajectory across ventral stream regions, in which face-selective regions show a particularly long developmental time course, taking more than a decade to become adult-like. We discuss the implications of these recent findings, how they relate to age-dependent improvements in recognition memory performance and propose possible neural mechanisms that might underlie this development. These results have important implications regarding the role of experience in shaping the ventral stream and the nature of the underlying representations.