Of the few preserved areas in the northeast of United States, the soil in the Pine Barrens Forests presents a harsh environment for the microorganisms to grow and survive. In the current study we report the use of clustering methods to scientifically select the sampling locations that would represent the entire forest and also report the microbial diversity present in various horizons of the soil. Sixty six sampling locations were selected across the forest and soils were collected from three horizons (sampling depths). The three horizons were 0-10 cm (Horizon O); 11-25 cm (Horizon A) and 26-40 cm (Horizon B). Based on the total microbial substrate utilization pattern and K-means clustering analysis, the soil in the Pine Barrens Forest can be classified into four distinct clusters at each of the three horizons. One soil sample from each of the four clusters were selected and archaeal and bacterial populations within the soil studied using pyrosequencing method. The results show the microbial communities present in each of these clusters are different. Within the microbial communities present, microorganisms involved in nitrogen cycle occupy a major fraction of microbial community in the soil. High level of diversity was observed for nitrogen fixing bacteria. In contrast, Nitrosovibrio and Nitrosocaldus spp are the single bacterial and archaeal population respectively carrying out ammonia oxidation in the soil.