Background: To evaluate the occurrence of erectile dysfunction at 3 years (3yED) after prostate brachytherapy (BT) and to predict 3yED after treatment based on patients and treatments characteristics. Material and methods: From September 2007 to July 2015, 117 men with mild or no ED [International Index of Erectile Function (IIEF-5) > 16] underwent 125Iodine real-time ultrasound-guided low-dose rate BT to a total dose of 160 Gy for low-risk or favorable intermediate-risk prostate adenocarcinoma, and were followed prospectively during 3 years. Median age was 63 years (51-79). The post-implant dosimetric parameters on the postoperative computer tomography were derived from the dose-volume histogram of the prostate and the penile bulb (PB), crura, neurovascular bundles (NVBs) and internal pudendal arteries (IPAs). Potential clinical confounding factors were collected. Additionally, anatomical indexes reflecting the prostate anatomical location within the pelvis were studied. These variables were compared between patients with and without 3yED. 3yED was defined as an IIEF-5 score change to the lower category between baseline, with or without medication. Results: The 3yED rate was 59% (62% maintained an IIEF-5 > 16). On multivariate analysis, prostate D90% (p > .5) and pretreatment characteristics including age (p > .5), pre-implant potency (p > .5), diabetes (p = .08) and high cardiovascular risk rates (p = .1) did not influence the occurrence of 3yED. Only the PB dose especially the D10% > 51 Gy was associated with 3yED (p = .005). Conversely, dose to the crura, IPAs or NVBs did not seem to impact the erectile function. The prostate position, especially the apex location varied significantly between potent and impotent patients and 3yED was significantly associated with close position of the prostate apex to PB (p = .008). Conclusion: The most predictive factor of 3yED was the dose to the PB. This may be explained by variation in individual patients' anatomy and this could allow for the development of better strategies to prevent ED.