Impaired bone formation is one of the major causes of low bone mass and skeletal fragility that occurs in osteoporosis. However, the mechanisms underlying the defects in bone formation are not well understood. Here, we report that big conductance calcium-activated potassium channels (BKs) are required for bone formation and osteoblast function both in vivo and in vitro. By 15 weeks of age, BK knockout (BKO) mice exhibited a decline in bone mineral density and trabecular bone volume of the tibiae and lumbar vertebrae, which were associated with impaired bone formation and osteoblast activity. Mechanistically, BK ablation in bone and bone marrow mesenchymal stem cells (BMSCs) of BKO mice inhibited integrin signaling. Furthermore, the binding of α subunit of BK with integrin β1 protein in osteoblasts was confirmed, and FAK-ERK1/2 signaling was proved to be involved by genetic modification of KCNMA1 (which encodes the α subunit of BK) in ROS17/2.8 osteoblast cells. These findings indicated that BK regulates bone formation by promoting osteoblast differentiation via integrin pathway, which provided novel insight into ion transporter crosstalk with the extracellular matrix in osteoblast regulation and revealed a new potential strategy for intervention in correcting bone formation defects.