Non-Abelian gauge fields are versatile tools for synthesizing topological phenomena, but have so far been mostly studied in Hermitian systems, where gauge flux has to be defined from a closed loop in order for vector potentials, whether Abelian or non-Abelian, to become physically meaningful. We show that this condition can be relaxed in non-Hermitian systems by proposing and studying a generalized Hatano-Nelson model with imbalanced non-Abelian hopping. Despite lacking gauge flux in one dimension, non-Abelian gauge fields create rich non-Hermitian topological consequences. With SU(2) gauge fields, the braiding degrees that can be achieved are twice the highest hopping order of a lattice model, indicating the utility of spinful freedom to attain high-order nontrivial braiding. At both ends of an open chain, non-Abelian gauge fields lead to the simultaneous presence of non-Hermitian skin modes, whose population can be effectively tuned near the exceptional points. Generalizing to two dimensions, the gauge invariance of Wilson loops can also break down in non-Hermitian lattices dressed with non-Abelian gauge fields. Toward realization, we present a concrete experimental proposal for non-Abelian gauge fields in non-Hermitian systems via the synthetic frequency dimension of a polarization-multiplexed fiber ring resonator.