Does target cell depletion, innate immunity, or adaptive immunity play the dominant role in controlling primary acute viral infections? Why do some individuals have higher peak virus titers than others? Answering these questions is a basic problem in immunology and can be particularly difficult in humans due to limited data, heterogeneity in responses in different individuals, and limited ability for experimental manipulation. We address these questions for infections following vaccination with the live attenuated yellow fever virus (YFV-17D) by analyzing viral load data from 80 volunteers. Using a mixed effects modeling approach, we find that target cell depletion models do not fit the data as well as innate or adaptive immunity models. Examination of the fits of the innate and adaptive immunity models to the data allows us to select a minimal model that gives improved fits by widely used model selection criteria (AICc and BIC) and explains why it is hard to distinguish between the innate and adaptive immunity models. We then ask why some individuals have over 1000-fold higher virus titers than others and find that most of the variation arises from differences in the initial/maximum growth rate of the virus in different individuals.