The extreme variability in the structural conformation of the human brain poses significant challenges for the creation of population-based atlases. The ability to statistically and visually compare and contrast brain image data from multiple individuals is essential to understanding normal variability within a particular population as well as differentiating normal from diseased populations. This paper introduces the application of probabilistic atlases that describe specific subpopulations, measures their variability and characterizes the structural differences between them. Utilizing data from structural MRI, we have built atlases with defined coordinate systems creating a framework for mapping data from functional, histological and other studies of the same population. This paper describes the basic approach and a brief description of the underlying mathematical constructs that enable the calculation of probabilistic atlases and examples of their results from several different normal and diseased populations.