Cryogenic sapphire oscillators (CSO) developed at the University of Western Australia (UWA) have now been in operation around the world continuously for many years. Such oscillators, due to their excellent spectral purity are essential for interrogating atomic frequency standards at the limit of quantum projection noise; otherwise aliasing effects will dominate the frequency stability due to the periodic sampling between successive interrogations of the atomic transition. Other applications, which have attracted attention in recent years, include tests on fundamental principles of physics, such as tests of Lorentz invariance. This paper reports on the long-term operation and performance of such oscillators. We compare the long-term drift of some different CSOs. The drift rates turn out to be linear over many years and in the same direction. However, the magnitude seems to vary by more than one order of magnitude between the oscillators, ranging from 10(14) per day to a few parts in 10(13) per day.