The Comprehensive Care Project: Measuring physician performance in ambulatory practice

Authors, Primary Holmboe,Eric S.;Weng,Weifeng;Arnold,Gerald K.;Kaplan,Sherrie H.;Normand,SharonLise;Greenfield,Sheldon;Hood,Sarah;Lipner,Rebecca S.
Title Primary The Comprehensive Care Project: Measuring physician performance in ambulatory practice
Periodical Full Health Services Research
Pub Year 2010
Volume 45
issue 6
Start Page 1912-1933
Abstract OBJECTIVE: To investigate the feasibility, reliability, and validity of comprehensively assessing physician-level performance in ambulatory practice. DATA SOURCES/STUDY SETTING: Ambulatory-based general internists in 13 states participated in the assessment. STUDY DESIGN: We assessed physician-level performance, adjusted for patient factors, on 46 individual measures, an overall composite measure, and composite measures for chronic, acute, and preventive care. Between- versus within-physician variation was quantified by intraclass correlation coefficients (ICC). External validity was assessed by correlating performance on a certification exam. DATA COLLECTION/EXTRACTION METHODS: Medical records for 236 physicians were audited for seven chronic and four acute care conditions, and six age- and gender-appropriate preventive services. PRINCIPAL FINDINGS: Performance on the individual and composite measures varied substantially within (range 5-86 percent compliance on 46 measures) and between physicians (ICC range 0.12-0.88). Reliabilities for the composite measures were robust: 0.88 for chronic care and 0.87 for preventive services. Higher certification exam scores were associated with better performance on the overall (r = 0.19; p<.01), chronic care (r = 0.14, p = .04), and preventive services composites (r = 0.17, p = .01). CONCLUSIONS: Our results suggest that reliable and valid comprehensive assessment of the quality of chronic and preventive care can be achieved by creating composite measures and by sampling feasible numbers of patients for each condition.
Publisher Not Available
Place of Publication Not Available
Author/Address Holmboe, Eric S.: eholmboe@abim.org; Holmboe, Eric S.: American Board of Internal Medicine, Philadelphia, PA, US Weng, Weifeng: American Board of Internal Medicine, Philadelphia, PA, US Arnold, Gerald K.: American Board of Internal Medicine, Phi)
PubMed Link
Reference Type(s) Journal Article
Topic Tag(s) Comprehensive Care;System Approach to Quality and Safety;Outcomes
Special Population(s) Individuals with Multiple Chronic Conditions
Case Study No
Commentary/Opinion Piece No
Historical Publication No
Key/Foundational Article No
Literature Review No
Article Rating No
Summary of Article Rating No