Surface ocean waters are dominated by planktonic bacterial lineages with highly reduced genomes. The best examples are the cyanobacterial genus Prochlorococcus, the alphaproteobacterial clade SAR11 and the gammaproteobacterial clade SAR86, which together represent over 50% of the cells in surface oceans. Several studies have identified signatures of selection on these lineages in today's ocean and have postulated selection as the primary force throughout their evolutionary history. However, massive loss of genomic DNA in these lineages often occurred in the distant past, and the selective pressures underlying these ancient events have not been assessed. Here, we probe ancient selective pressures by computing %GC-corrected rates of conservative and radical nonsynonymous nucleotide substitutions. Surprisingly, we found an excess of radical changes in several of these lineages in comparison to their relatives with larger genomes. Furthermore, analyses of allelic genome sequences of several populations within these lineages consistently supported that radical replacements are more likely to be deleterious than conservative changes. Our results suggest coincidence of massive genomic DNA losses and increased power of genetic drift, but we also suggest that additional evidence independent of the nucleotide substitution analyses is needed to support a primary role of genetic drift driving ancient genome reduction of marine bacterioplankton lineages.