Marianna Shershneva (University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA); Curtis Olson (University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA)

This study was funded by an educational grant from Pfizer. The authors have nothing else to disclose.

Synopsis

We used a modified Success Case Method (SCM) to evaluate three continuing medical education performance improvement activities on smoking cessation, focusing on the mechanisms linking education and practice change; we then assessed stakeholder perceptions of the value of this method. Our study showed that SCM can enhance and supplement traditional evaluation methods.

Purpose

Evaluations are rarely designed to explore how and why educational interventions contributed to observed outcomes. We used a modified Success Case Method (SCM) to evaluate three continuing medical education performance improvement activities on smoking cessation, focusing on the mechanisms linking education and practice change; we then assessed stakeholder perceptions of the value of this method.

Methods

Using interviews, we studied nine outpatient practices that participated in the educational activities and showed a high degree of improvement on eight performance measures. An evaluation report including detailed cases and a cross-case analysis was prepared and distributed. We then conducted group and individual interviews with ten CME planners/other stakeholders to understand their perspective on the value of the report.

Results

Stakeholders found the report provided new insight into how their activities functioned in practice, validated or suggested changes in their program theories and strategies. They also identified ways they intended to use the results. Lengthy case reports were seen as a barrier but also the source of valuable information.

Conclusions

SCM provided stakeholders with a unique evaluation perspective, deeper understanding of how context affects outcomes, and strategies for designing more effective interventions. SCM can enhance and supplement traditional evaluation methods.

Funding Sources

This study was funded by an educational grant from Pfizer.