Due to a lack of sufficient diagnostic tools to predict aggressive disease, there is a significant overtreatment of patients with prostate cancer. Platelet derived growth factors (PDGFs) and their receptors (PDGFRs) are key regulators of mesenchymal cells in the tumor microenvironment, and has been associated with unfavorable outcome in several other cancers. Herein, we aimed to investigate the prognostic impact of PDGFR-β and its ligands (PDGF-B and PDGF-D) in a multicenter prostatectomy cohort of 535 Norwegian patients. Using tissue microarrays and immunohistochemistry, the expression of ligands PDGF-B and PDGF-D and their corresponding receptor, PDGFR-β, was assessed in neoplastic tissue and tumor-associated stroma. PDGFR-β was expressed in benign and tumor associated stroma, but not in epithelium. High stromal expression of PDGFR-β was independently associated with clinical relapse (HR = 2.17, p = 0.010) and biochemical failure (HR = 1.58, p = 0.002). This large study highlights the prognostic importance of PDGFR-β expression, implicating its involvement in prostate cancer progression even in early stage disease. Hence, analyses of PDGFR-β may help distinguish which patients will benefit from radical treatment, and since PDGFR-β is associated with relapse and shorter survival, it mandates a focus as a therapeutic target.