Terminal restriction fragment length polymorphism (T-RFLP) was used to examine the community diversity of bacteria and arbuscular mycorrhizal fungi (AMF) and their interrelation in the rhizosphere of 8 plants in the Liudaogou watershed in Shenmu County. The objective was to obtain diversity indices and provide theoretical basis for ecological restoration. Results showed significant variations in the species and abundances of rhizospheric bacteria and AMF associated with 8 plants. Among these, the Shannon diversity index of rhizospheric bacteria was the highest for Robinia pseudoacacia (4.01) and the lowest for Salix babylonica (2.18), whereas the Shannon diversity index of rhizospheric AMF was the highest for Populus simonii (2.07) and the lowest for Hippophae rhamnoides (1.21). Cluster analysis and redundancy analysis indicated a significant difference in associated microbial community structure, while the similarity among community diversity of rhizospheric bacteria and AMF associated with specific plants was also found. There was a significant correlation between diversity indices of bacteria and AMF (P < 0.01). Associated microbial community diversity was influenced primarily by organic matter and total nitrogen content. Our work demonstrated strong impacts of plant species and rhizospheric environment on associated microbial community structure. Due to the high diversity indices of rhizospheric bacteria and AMF, R. pseudoacacia was considered to be a pioneer plant species for vegetation restoration in the Liudaogou watershed.