Observers adapted to drifting patterns varying either in luminance (first-order pattern), or in contrast (second-order pattern). Sensitivity to increases or decreases in the speed of the first-order pattern increased sharply as adaptation time increased, but sensitivity to speed changes of the second-order pattern remained unchanged throughout the adaptation time. Adaptation of first-order motion mechanisms seems thus to mediate increased sensitivity to variations in speed around the adapting speed. No evidence was found for such effects of adaptation to second-order motion. The observed differences in the effects of adaptation accord well with reports of fundamental differences between after-effects to drifting first- and second-order patterns and are in harmony with models of motion perception emphasizing different mechanisms for the detection of first- and second-order motion.