Transfer of ubiquitin to substrate proteins regulates most processes in eukaryotic cells. E2 enzymes are a central component of the ubiquitin machinery, and generally determine the type of ubiquitin signal generated and thus the ultimate fate of substrate proteins. The E2, Ube2k, specifically builds degradative ubiquitin chains on diverse substrates. Here we have identified protein-based reagents, called ubiquitin variants (UbVs), that bind tightly and specifically to Ube2k. Crystal structures reveal that the UbVs bind to the E2 enzyme at a hydrophobic cleft that is distinct from the active site and previously identified ubiquitin binding sites. We demonstrate that the UbVs are potent inhibitors of Ube2k and block both ubiquitin charging of the E2 enzyme and E3-catalyzed ubiquitin transfer. The binding site of the UbVs suggests they directly clash with the ubiquitin activating enzyme, while potentially disrupting interactions with E3 ligases via allosteric effects. Our data reveal the first protein-based inhibitors of Ube2k and unveil a hydrophobic groove that could be an effective target for inhibiting Ube2k and other E2 enzymes.