One of the longest running debates in ecology is whether chance or determinism structures biotic communities, and this question is often studied by looking for the presence or absence of community inertia (lack of change) over time or space. Results have been equivocal. We adopted three tactics for a fresh approach: (i) allowing the answer to vary with the geographic, temporal, and taxonomic scale of study, (ii) using appropriate reference points for the amount of inertia in random biological systems, and (iii) using a robust approach for measurement of inertia. We examined fossil assemblages of mammalian communities across almost 1,000,000 years and at sites spanning approximately 3,500 km. We showed that in general there is good evidence for inertia but that the results change in a quantifiable fashion with taxonomic, spatial, and temporal scales. By using neutral theory we place a reference point on the degree of inertia and demonstrate that empirical mammalian communities show greater inertia than neutral communities over time scales >3,000 year. Although our results do not specifically reveal mechanism, they emphasize that deterministic forces are at work in structuring communities over millennia.