We acquire and compare three-dimensional tomographic breast images of three females with suspicious masses using diffuse optical tomography (DOT) and positron emission tomography (PET). Co-registration of DOT and PET images was facilitated by a mutual information maximization algorithm. We also compared DOT and whole-body PET images of 14 patients with breast abnormalities. Positive correlations were found between total hemoglobin concentration and tissue scattering measured by DOT, and fluorodeoxyglucose (18F-FDG) uptake. In light of these observations, we suggest potential benefits of combining both PET and DOT for characterization of breast lesions.