Building evaluation capacity in Ontario's public health units: promising practices and strategies

Abstract

Objectives: This article presents the findings of a project focusing on building evaluation capacity in 10 Ontario public health units. The study sought to identify effective strategies that lead to increased evaluation capacity in the participating organizations.

Study design: This study used a qualitative, multiple case research design.

Methods: An action research methodology was used to design customized evaluation capacity building (ECB) strategies for each participating organization, based on its specific context and needs. This methodological approach also enabled monitoring and assessment of each strategy, based on a common set of reporting templates. A multiple case study was used to analyze the findings from the 10 participating organizations and derive higher level findings.

Results: The main findings of the study show that most of the strategies used to increase evaluation capacity in public health units are promising, especially those focusing on developing the knowledge, skills, and attitudes of health unit staff and managers. Facilitators to ECB strategies were the engagement of all staff members, the support of leadership, and the existence of organizational tools and infrastructure to support evaluation. It is also essential to recognize that ECB takes time and resources to be successful.

Conclusions: The design and implementation of ECB strategies should be based on organizational needs. These can be assessed using a standardized instrument, as well as interviews and staff surveys. The implementation of a multicomponent approach (i.e. several strategies implemented simultaneously) is also linked to better ECB outcomes in organizations.

Keywords: Evaluation capacity building; Evaluation utilization; Program evaluation; Public health organizations.