During a test of the ability to classify the profusion characteristics of pneumoconiosis recorded in chest radiographs, a constant decision criterion level needs to be maintained or false conclusions regarding the observer's receiver operating characteristic (ROC) curve may result.