Facility delivery is an important aspect of the strategy to reduce maternal and newborn mortality. Geographic access to care is a strong determinant of facility delivery, but few studies have simultaneously considered the influence of facility quality, with inconsistent findings. In rural Brong Ahafo region in Ghana, we combined surveillance data on 11,274 deliveries with quality of care data from all 64 delivery facilities in the study area. We used multivariable multilevel logistic regression to assess the influence of distance and several quality dimensions on place of delivery. Women lived a median of 3.3 km from the closest delivery facility, and 58% delivered in a facility. The probability of facility delivery ranged from 68% among women living 1 km from their closest facility to 22% among those living 25 km away, adjusted for confounders. Measured quality of care at the closest facility was not associated with use, except that facility delivery was lower when the closest facility provided substandard care on the EmOC dimension. These results do not imply, however, that we should increase geographic accessibility of care without improving facility quality. While this may be successful in increasing facility deliveries, such care cannot be expected to reduce maternal and neonatal mortality.