A number of structures have been solved for the Envelope (E) protein from dengue virus and closely related flaviviruses, providing detailed pictures of the conformational states of the protein at different stages of infectivity. However, the key functional residues responsible for mediating the dynamic changes between these structures remain largely unknown. Using a comprehensive library of functional point mutations covering all 390 residues of the dengue virus E protein ectodomain, we identified residues that are critical for virus infectivity, but that do not affect E protein expression, folding, virion assembly, or budding. The locations and atomic interactions of these critical residues within different structures representing distinct fusogenic conformations help to explain how E protein (i) regulates fusion-loop exposure by shielding, tethering, and triggering its release; (ii) enables hinge movements between E domain interfaces during triggered structural transformations; and (iii) drives membrane fusion through late-stage zipper contacts with stem. These results provide structural targets for drug and vaccine development and integrate the findings from structural studies and isolated mutagenesis efforts into a cohesive model that explains how specific residues in this class II viral fusion protein enable virus infectivity.