دورية أكاديمية
Evaluation of physicians' professional performance: an iterative development and validation study of multisource feedback instruments.
العنوان: | Evaluation of physicians' professional performance: an iterative development and validation study of multisource feedback instruments. |
---|---|
المؤلفون: | Overeem K; IQ healthcare, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands. k.overeem@iq.umcn.nl, Wollersheim HC, Arah OA, Cruijsberg JK, Grol RP, Lombarts KM |
المصدر: | BMC health services research [BMC Health Serv Res] 2012 Mar 26; Vol. 12, pp. 80. Date of Electronic Publication: 2012 Mar 26. |
نوع المنشور: | Journal Article; Validation Study |
اللغة: | English |
بيانات الدورية: | Publisher: BioMed Central Country of Publication: England NLM ID: 101088677 Publication Model: Electronic Cited Medium: Internet ISSN: 1472-6963 (Electronic) Linking ISSN: 14726963 NLM ISO Abbreviation: BMC Health Serv Res Subsets: MEDLINE |
أسماء مطبوعة: | Original Publication: London : BioMed Central, [2001- |
مواضيع طبية MeSH: | Clinical Competence*/standards , Clinical Competence*/statistics & numerical data , Interprofessional Relations*, Employee Performance Appraisal/*methods , Peer Review, Health Care/*methods , Physicians/*standards , Psychometrics/*instrumentation, Academic Medical Centers ; Employee Performance Appraisal/statistics & numerical data ; Feedback ; Female ; Humans ; Linear Models ; Male ; Netherlands ; Physician-Patient Relations ; Physicians/psychology ; Physicians/statistics & numerical data ; Reproducibility of Results ; Self-Assessment ; Socioeconomic Factors ; Surveys and Questionnaires ; Total Quality Management/standards |
مستخلص: | Background: There is a global need to assess physicians' professional performance in actual clinical practice. Valid and reliable instruments are necessary to support these efforts. This study focuses on the reliability and validity, the influences of some sociodemographic biasing factors, associations between self and other evaluations, and the number of evaluations needed for reliable assessment of a physician based on the three instruments used for the multisource assessment of physicians' professional performance in the Netherlands. Methods: This observational validation study of three instruments underlying multisource feedback (MSF) was set in 26 non-academic hospitals in the Netherlands. In total, 146 hospital-based physicians took part in the study. Each physician's professional performance was assessed by peers (physician colleagues), co-workers (including nurses, secretary assistants and other healthcare professionals) and patients. Physicians also completed a self-evaluation. Ratings of 864 peers, 894 co-workers and 1960 patients on MSF were available. We used principal components analysis and methods of classical test theory to evaluate the factor structure, reliability and validity of instruments. We used Pearson's correlation coefficient and linear mixed models to address other objectives. Results: The peer, co-worker and patient instruments respectively had six factors, three factors and one factor with high internal consistencies (Cronbach's alpha 0.95 - 0.96). It appeared that only 2 percent of variance in the mean ratings could be attributed to biasing factors. Self-ratings were not correlated with peer, co-worker or patient ratings. However, ratings of peers, co-workers and patients were correlated. Five peer evaluations, five co-worker evaluations and 11 patient evaluations are required to achieve reliable results (reliability coefficient ≥ 0.70). Conclusions: The study demonstrated that the three MSF instruments produced reliable and valid data for evaluating physicians' professional performance in the Netherlands. Scores from peers, co-workers and patients were not correlated with self-evaluations. Future research should examine improvement of performance when using MSF. |
References: | CMAJ. 1999 Jul 13;161(1):52-7. (PMID: 10420867) BMJ. 2003 Mar 8;326(7388):546-8. (PMID: 12623920) Health Serv Res. 2006 Feb;41(1):284-301. (PMID: 16430612) Pediatrics. 2006 Mar;117(3):796-802. (PMID: 16510660) Postgrad Med J. 2010 Sep;86(1019):526-31. (PMID: 20841329) Acad Med. 2003 Oct;78(10 Suppl):S42-4. (PMID: 14557092) Patient Educ Couns. 2007 Aug;67(3):333-42. (PMID: 17574367) Health Policy. 2001 Dec;58(3):191-213. (PMID: 11640999) Anesthesiology. 2009 Oct;111(4):709-16. (PMID: 19707115) Qual Saf Health Care. 2008 Jun;17(3):187-93. (PMID: 18519625) Med Teach. 2010;32(2):141-7. (PMID: 20163230) BMJ. 2005 May 28;330(7502):1251-3. (PMID: 15883137) Acad Emerg Med. 2006 Dec;13(12):1296-303. (PMID: 17099191) BMJ. 2010 Sep 24;341:c5064. (PMID: 20870696) Radiology. 2008 Jun;247(3):771-8. (PMID: 18375839) Med Care. 1993 Sep;31(9):834-45. (PMID: 8366685) Can J Anaesth. 2006 Jan;53(1):33-9. (PMID: 16371607) JAMA. 1993 Apr 7;269(13):1655-60. (PMID: 8240483) JAMA. 2006 Sep 6;296(9):1094-102. (PMID: 16954489) BMJ. 2011 Oct 27;343:d6212. (PMID: 22034193) Med Educ. 2008 Oct;42(10):1014-20. (PMID: 18823521) Med Educ. 2008 Apr;42(4):364-73. (PMID: 18338989) |
تواريخ الأحداث: | Date Created: 20120328 Date Completed: 20120905 Latest Revision: 20211021 |
رمز التحديث: | 20231215 |
مُعرف محوري في PubMed: | PMC3349515 |
DOI: | 10.1186/1472-6963-12-80 |
PMID: | 22448816 |
قاعدة البيانات: | MEDLINE |
تدمد: | 1472-6963 |
---|---|
DOI: | 10.1186/1472-6963-12-80 |