This paper takes a broad view of the work involved in pilot studies of evaluation research. Drawing on their experience of preparation for a field experiment in a British Accident and Emergency department, which was to evaluate the effectiveness of a nurse triage system, the authors stress the importance of careful observation of the system to be studied, in the environment in which it is to be studied. In addition, the usual evaluations of research instruments which comprise formal pilot studies are included.