The goal of this study was to assess the relationship between Aβ deposition and white matter pathology (i.e., white matter hyperintensities, WMH) on microstructural integrity of the white matter. Fifty-seven participants (mean age: 78±7 years) from an ongoing multi-site research program who spanned the spectrum of normal to mild cognitive impairment (Clinical dementia rating 0-0.5) and low to high risk factors for arteriosclerosis and WMH pathology (defined as WMH volume >0.5% total intracranial volume) were assessed with positron emission tomography (PET) with Pittsburg compound B (PiB) and magnetic resonance and diffusion tensor imaging (DTI). Multivariate analysis of covariance were used to investigate the relationship between Aβ deposition and WMH pathology on fractional anisotropy (FA) from 9 tracts of interest (i.e., corona radiata, internal capsule, cingulum, parahippocampal white matter, corpus callosum, superior longitudinal, superior and inferior front-occipital fasciculi, and fornix). WMH pathology was associated with reduced FA in projection (i.e., internal capsule and corona radiate) and association (i.e., superior longitudinal, superior and inferior fronto-occipital fasciculi) fiber tracts. Aβ deposition (i.e., PiB positivity) was associated with reduced FA in the fornix and splenium of the corpus callosum. There were interactions between PiB and WMH pathology in the internal capsule and parahippocampal white matter, where Aβ deposition reduced FA more among subjects with WMH pathology than those without. However, accounting for apoE ε4 genotype rendered these interactions insignificant. Although this finding suggests that apoE4 may increase amyloid deposition, both in the parenchyma (resulting in PiB positivity) and in blood vessels (resulting in amyloid angiopathy and WMH pathology), and that these two factors together may be associated with compromised white matter microstructural integrity in multiple brain regions, additional studies with a longitudinal design will be necessary to resolve this issue.