The belowground soil prokaryotic community plays a cardinal role in sustaining the stability and functions of forest ecosystems. Yet, the nature of how soil prokaryotic diversity co-varies with aboveground plant diversity along a latitudinal gradient remains elusive. By establishing three hundred 400-m(2) quadrats from tropical rainforest to boreal forest in a large-scale parallel study on both belowground soil prokaryote and aboveground tree and herb communities, we found that soil prokaryotic diversity couples with the diversity of herbs rather than trees. The diversity of prokaryotes and herbs responds similarly to environmental factors along the latitudinal gradient. These findings revealed that herbs provide a good predictor of belowground biodiversity in forest ecosystems, and provide new perspective on the aboveground and belowground interactions in forest ecosystems.