Viruses are ubiquitous and cause significant mortality in marine bacterial and archaeal communities. Little is known about the role of viruses in the sub-seafloor biosphere, which hosts a large fraction of all microbes on Earth. We quantified and characterized viruses in sediments from the Baltic Sea. The results show that the Baltic Sea sub-seafloor biosphere harbors highly abundant viruses with densities up to 1.8 × 1010 viruses cm-3. High potential viral production down to 37 meters below seafloor in ca. 6000-years-old sediments and infected prokaryotic cells visible by transmission electron microscopy demonstrate active viral infection. Morphological and molecular data indicate that the highly diverse community of viruses includes both allochthonous input from the overlying seawater and autochthonous production. The detection of cyanophage-like sequences showed that viruses of phototrophic hosts may persist in marine sediments for thousands of years. Our results imply that viruses influence sub-seafloor microbial community dynamics and thereby affect biogeochemical processes in the sub-seafloor biosphere.