There is currently a paucity of reliable techniques for predicting the response of breast tumors to neoadjuvant chemotherapy. The standard approach is to monitor gross changes in tumor size as measured by physical exam and/or conventional imaging, but these methods generally do not show whether a tumor is responding until the patient has received many treatment cycles. One promising approach to address this clinical need is to integrate quantitative in vivo imaging data into biomathematical models of tumor growth in order to predict eventual response based on early measurements during therapy. In this work, we illustrate a novel biomechanical mathematical modeling approach in which contrast enhanced and diffusion weighted magnetic resonance imaging data acquired before and after the first cycle of neoadjuvant therapy are used to calibrate a patient-specific response model which subsequently is used to predict patient outcome at the conclusion of therapy. We present a modification of the reaction-diffusion tumor growth model whereby mechanical coupling to the surrounding tissue stiffness is incorporated via restricted cell diffusion. We use simulations and experimental data to illustrate how incorporating tissue mechanical properties leads to qualitatively and quantitatively different tumor growth patterns than when such properties are ignored. We apply the approach to patient data in a preliminary dataset of eight patients exhibiting a varying degree of responsiveness to neoadjuvant therapy, and we show that the mechanically coupled reaction-diffusion tumor growth model, when projected forward, more accurately predicts residual tumor burden at the conclusion of therapy than the non-mechanically coupled model. The mechanically coupled model predictions exhibit a significant correlation with data observations (PCC = 0.84, p < 0.01), and show a statistically significant >4 fold reduction in model/data error (p = 0.02) as compared to the non-mechanically coupled model.