Heat shock protein 90 (Hsp90) is an essential molecular chaperone in eukaryotes that facilitates the conformational maturation and function of a diverse protein clientele, including aberrant and/or over-expressed proteins that are involved in cancer growth and survival. A role for Hsp90 in supporting the protein homeostasis of cancer cells has buoyed interest in the utility of Hsp90 inhibitors as anti-cancer drugs. Despite the fact that all clinically evaluated Hsp90 inhibitors target an identical nucleotide-binding pocket in the N domain of the chaperone, the precise determinants that affect drug binding in the cellular environment remain unclear, and it is possible that chemically distinct inhibitors may not share similar binding preferences. Here we demonstrate that two chemically unrelated Hsp90 inhibitors, the benzoquinone ansamycin geldanamycin and the purine analog PU-H71, select for overlapping but not identical subpopulations of total cellular Hsp90, even though both inhibitors bind to an amino terminal nucleotide pocket and prevent N domain dimerization. Our data also suggest that PU-H71 is able to access a broader range of N domain undimerized Hsp90 conformations than is geldanamycin and is less affected by Hsp90 phosphorylation, consistent with its broader and more potent anti-tumor activity. A more complete understanding of the impact of the cellular milieu on small molecule inhibitor binding to Hsp90 should facilitate their more effective use in the clinic.