Best Practices / Research Oral Abstract

How to Assess Clinical Performance of Radiologists: The Structured Oral Interview (O043)

François Goulet (Collège des médecins du Québec); Johanne Thiffault (Collège des médecins du Québec); Marguerite Dupré (Collège des médecins du Québec); Roger Ladouceur (Collège des médecins du Québec); Louise Samson (Université de Montréal); Jean-François Desjardins (CH de Saint-Jérôme); Guy Mérette (CSSS de Verdun); Normand Charlebois (CH Cité-de-la-Santé de Laval); Yves Drouin
(CH Sainte-Croix de Drummondville); Sylvie Groleau (CH Charles-Lemoyne de Longueuil); Danielle Gilbert (CH Sacré-Coeur de Montréal)

Purpose

Since 2002, the Collège des médecins du Québec (CMQ), the medical licensing authority in Quebec, has been assessing the clinical performance of radiologists through the structured oral interview (SOI). The SOI, supervised by two peers, is an evaluation tool that uses imaging as well as realistic and representative clinical vignettes (cases). All vignettes, developed and validated by a team of experts in diagnostic radiology, consist of a variable number of questions with expected answers based on the key features approach.

Methods

The SOI is a four-part assessment process that includes:

1. On the spot film diagnosis (snapper) (10 cases)
2. Film interpretation and dictated report (10 cases)
3. Relevant findings (positive and negative) using differential diagnosis (10 cases) 4. Skills evaluation, and interpretation of ultrasonography (5-10 cases)

Results

From 2002 to July 2011, 40 radiologists were assessed. The clinical performance was judged adequate for 14 among them; 11 received recommendations to do CME; 6 were imposed a part-time remedial training program; 8 were imposed a full-time training program, with limitation of practice and 1 was recommanded for short-term peer review.

Conclusion

The SOI is a valid and relevant tool to assess the clinical performance of practicing radiologists, and to determine the remedial program corresponding to their educational needs.