Different grazing strategies impact grassland plant production and may also regulate the soil carbon formation. For a site in semiarid temperate steppe, we studied the effect of combinations of rest, high and moderate grazing pressure over three stages of the growing season, on the process involved in soil carbon sequestration. Results show that constant moderate grazing (MMM) exhibited the highest root production and turnover accumulating the most soil carbon. While deferred grazing (RHM and RMH) sequestered less soil carbon compared to MMM, they showed higher standing root mass, maintained a more desirable pasture composition, and had better ability to retain soil N. Constant high grazing pressure (HHH) caused diminished above- and belowground plant production, more soil N losses and an unfavorable microbial environment and had reduced carbon input. Reducing grazing pressure in the last grazing stage (HHM) still had a negative impact on soil carbon. Regression analyses show that adjusting stocking rate to ~5SE/ha with ~40% vegetation utilization rate can get the most carbon accrual. Overall, the soil carbon sequestration in the temperate grassland is affected by the grazing regime that is applied, and grazing can be altered to improve soil carbon sequestration in the temperate steppe.