Genome-wide association studies (GWAS) of adolescents and adults are transforming our understanding of how genetic variants impact brain structure and psychiatric risk, but cannot address the reality that psychiatric disorders are unfolding developmental processes with origins in fetal life. To investigate how genetic variation impacts prenatal brain development, we conducted a GWAS of global brain tissue volumes in 561 infants. An intronic single-nucleotide polymorphism (SNP) in IGFBP7 (rs114518130) achieved genome-wide significance for gray matter volume (P=4.15 × 10-10). An intronic SNP in WWOX (rs10514437) neared genome-wide significance for white matter volume (P=1.56 × 10-8). Additional loci with small P-values included psychiatric GWAS associations and transcription factors expressed in developing brain. Genetic predisposition scores for schizophrenia and ASD, and the number of genes impacted by rare copy number variants (CNV burden) did not predict global brain tissue volumes. Integration of these results with large-scale neuroimaging GWAS in adolescents (PNC) and adults (ENIGMA2) suggests minimal overlap between common variants impacting brain volumes at different ages. Ultimately, by identifying genes contributing to adverse developmental phenotypes, it may be possible to adjust adverse trajectories, preventing or ameliorating psychiatric and developmental disorders.