Health information technology evaluators need to distinguish between intervention efficacy as assessed in the ideal circumstances of clinical trials and intervention effectiveness as assessed in the real world circumstances of actual practice. We have developed a framework for implementation fidelity evaluation with methods for estimating intervention effectiveness and efficacy. We apply this framework to evaluate an ongoing health information technology clinical trial.