Mono- and polyubiquitylation of proteins are key steps in a wide range of biological processes. However, the molecular mechanisms that mediate these different events are poorly understood. Here, we employed NMR spectroscopy to map a non-covalent ubiquitin binding surface (UBS) on the Smurf ubiquitin ligase HECT domain. Analysis of mutants of the HECT UBS reveal that interfering with the UBS surface blocked Smurf-dependent degradation of its substrate RhoA in cells. In vitro analysis revealed that the UBS was not required for UbcH7-dependent charging of the HECT catalytic cysteine. Surprisingly, although the UBS was required for polyubiquitylation of both Smurf itself and the Smurf substrate RhoA, it was not required for monoubiquitylation. Furthermore, we show that mutating the UBS interfered with efficient binding of a monoubiquitylated form of RhoA to the Smurf HECT domain. Our findings suggest the UBS promotes polyubiquitylation by stabilizing ubiquitylated substrate binding to the HECT domain.