The band-edge optical response of transition metal dichalcogenides, an emerging class of atomically thin semiconductors, is dominated by tightly bound excitons localized at the corners of the Brillouin zone (valley excitons). A fundamental yet unknown property of valley excitons in these materials is the intrinsic homogeneous linewidth, which reflects irreversible quantum dissipation arising from system (exciton) and bath (vacuum and other quasiparticles) interactions and determines the timescale during which excitons can be coherently manipulated. Here we use optical two-dimensional Fourier transform spectroscopy to measure the exciton homogeneous linewidth in monolayer tungsten diselenide (WSe2). The homogeneous linewidth is found to be nearly two orders of magnitude narrower than the inhomogeneous width at low temperatures. We evaluate quantitatively the role of exciton-exciton and exciton-phonon interactions and population relaxation as linewidth broadening mechanisms. The key insights reported here—strong many-body effects and intrinsically rapid radiative recombination—are expected to be ubiquitous in atomically thin semiconductors.