Reef-building corals host assemblages of symbiotic algae (Symbiodinium spp.) whose diversity and abundance may fluctuate under different conditions, potentially facilitating acclimatization to environmental change. The composition of free-living Symbiodinium in reef waters and sediments may also be environmentally labile and may influence symbiotic assemblages by mediating supply and dispersal. The magnitude and spatial scales of environmental influence over Symbiodinium composition in different reef habitat compartments are, however, not well understood. We used pyrosequencing to compare Symbiodinium in sediments, water, and ten coral species between two backreef pools in American Samoa with contrasting thermal environments. We found distinct compartmental assemblages of clades A, C, D, F, and/or G Symbiodinium types, with strong differences between pools in water, sediments, and two coral species. In the pool with higher and more variable temperatures, abundance of various clade A and C types differed compared to the other pool, while abundance of D types was lower in sediments but higher in water and in Pavona venosa, revealing an altered habitat distribution and potential linkages among compartments. The lack of between-pool effects in other coral species was due to either low overall variability (in the case of Porites) or high within-pool variability. Symbiodinium communities in water and sediment also showed within-pool structure, indicating that environmental influences may operate over multiple, small spatial scales. This work suggests that Symbiodinium composition is highly labile in reef waters, sediments, and some corals, but the underlying drivers and functional consequences of this plasticity require further testing with high spatial resolution biological and environmental sampling.