Mechanical stimulation and histone deacetylases (HDACs) have essential roles in regulating the osteogenic differentiation of bone marrow stromal cells (BMSCs) and bone formation. However, little is known regarding what regulates HDAC expression and therefore the osteogenic differentiation of BMSCs during osteogenesis. In this study, we investigated whether mechanical loading regulates HDAC expression directly and examined the role of HDACs in mechanical loading-triggered osteogenic differentiation and bone formation. We first studied the microarrays of samples from patients with osteoporosis and found that the NOTCH pathway and skeletal development gene sets were downregulated in the BMSCs of patients with osteoporosis. Then we demonstrated that mechanical stimuli can regulate osteogenesis and bone formation both in vivo and in vitro. NOTCH signaling was upregulated during cyclic mechanical stretch (CMS)-induced osteogenic differentiation, whereas HDAC1 protein expression was downregulated. The perturbation of HDAC1 expression also had a significant effect on matrix mineralization and JAG1-mediated Notch signaling, suggesting that HDAC1 acts as an endogenous attenuator of Notch signaling in the mechanotransduction of BMSCs. Chromatin immunoprecipitation (ChIP) assay results suggest that HDAC1 modulates the CMS-induced histone H3 acetylation level at the JAG1 promoter. More importantly, we found an inhibitory role of Hdac1 in regulating bone formation in response to hindlimb unloading in mice, and pretreatment with an HDAC1 inhibitor partly rescued the osteoporosis caused by mechanical unloading. Our results demonstrate, for the first time, that mechanical stimulation orchestrates genes expression involved in the osteogenic differentiation of BMSCs via the direct regulation of HDAC1, and the therapeutic inhibition of HDAC1 may be an efficient strategy for enhancing bone formation under mechanical stimulation.