Population health datasets are a valuable resource for studying maternal and obstetric health outcomes. However, their validity has not been thoroughly examined. We compared medical records from a random selection of New South Wales (NSW) women who gave birth in a NSW hospital in 2002 with coded hospital discharge records. We estimated the population prevalence of maternal medical conditions during pregnancy and found a tendency towards underreporting although specificities were high, indicating that false positives were uncommon.