Human listeners hear an asymmetry in the perception of damped and ramped sinusoids; the partial loudness of the envelope component is greater than the partial loudness of the carrier component for damped sinusoids. Here we show that an asymmetry also occurs in the physiological responses of most units in the ventral cochlear nucleus to these same sounds. The activity elicited by damped sinusoids is mainly restricted to the beginning of each envelope period, which is not the case for ramped sinusoids. This can be quantified by computing the ratio of the tallest bin of the modulation period histogram to the total number of spikes (the peak-to-total ratio, p/t). Damped sinusoids produce a higher p/t than ramped sinusoids, which demonstrates physiological temporal asymmetry. It is also the case that ramped sinusoids typically elicit more spikes than damped sinusoids. The physiological asymmetry occurs where the perceptual asymmetry is present. It is maximal at modulation half-lives of 4 and 16 ms, greatly reduced at 1 ms and absent at 64 ms. Different unit types exhibit differing degrees of temporal asymmetry. Onset units produce the greatest p/t asymmetry, primary-like units produce the least asymmetry and chopper units are in-between. With regard to total spike count, the maximal asymmetry occurs with chopper units. If primary-like units are assumed to reflect the activity in primary auditory nerve fibres, then there is enhancement of temporal asymmetry in the ventral cochlear nucleus by both onset and chopper units.