Evaluation of changes in quality improvement knowledge following a formal educational curriculum within a statewide learning collaborative Journal Article


Authors: Berger, E. R.; Kreutzer, L.; Halverson, A.; Yang, A. D.; Reinhart, S.; O'Leary, K. J.; Williams, M. V.; Bilimoria, K. Y.; Johnson, J. K.; on behalf of the ISQIC Advisory Committee
Article Title: Evaluation of changes in quality improvement knowledge following a formal educational curriculum within a statewide learning collaborative
Abstract: Objective: Our objectives were to (1) develop a curriculum based upon participants’ needs, (2) evaluate baseline QI knowledge of the Illinois Surgical Quality Improvement Collaborative (ISQIC) members, and (3) evaluate the effectiveness of the educational curriculum. Design: The Surgeon Champion (SC), Surgical Clinical Reviewer (SCR), and QI Designee at each ISQIC hospital completed a QI curriculum containing online modules and in-person trainings. A surgical adaptation of QI-KAT, a validated QI knowledge assessment with multiple-choice and free-response sections, was administered pre- and postcurriculum. Three blinded educators scored each exam using a rubric-based scoring tool (54 total points). Setting: The ISQIC is a 52-hospital learning collaborative. Generally, ISQIC participants had little prior formal training or experience with quality improvement. Results: Among 52 hospitals, 144 pretests and 112 post-tests were collected. Mean scores increased from 66% (35.6 points) to 77% (41.6 points; p < 0.001). Across all hospitals, all participant groups scored higher on the post-test (SCs 15%, SCRs 21%, QI Designees 17%). There was no significant difference in post-test mean scores among different team members: SCs 44 points, SCRs 42 points, QI Designees 44 points, (p = 0.76). When the post-test scores were aggregated at the hospital level, hospitals with new surgical QI programs improved more than hospitals with established programs (new 18%, established 11%, p < 0.05). Conclusions: QI knowledge significantly improved after completion of the ISQIC curriculum. These data support the value of formalized curricula to rapidly advance QI knowledge and application skills as a foundation for implementing QI initiatives. © 2020 Association of Program Directors in Surgery
Keywords: adult; controlled study; education; curriculum; total quality management; surgeon; surgery; skill; learning; quality improvement; comparative effectiveness; pretest posttest design; human; article; illinois; process improvement; quality improvement collaborative (qic)
Journal Title: Journal of Surgical Education
Volume: 77
Issue: 6
ISSN: 1931-7204
Publisher: Elsevier Science, Inc.  
Date Published: 2020-11-01
Start Page: 1534
End Page: 1541
Language: English
DOI: 10.1016/j.jsurg.2020.04.018
PUBMED: 32553540
PROVIDER: scopus
DOI/URL:
Notes: Article -- Export Date: 4 January 2021 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Elizabeth Rapp Berger
    7 Berger