Assessing doctors' competencies using multisource feedback: validating a Japanese version of the Sheffield Peer Review Assessment Tool (SPRAT)
dc.contributor.author | Sasaki, H | |
dc.contributor.author | Archer, Julian | |
dc.contributor.author | Yonemoto, N | |
dc.contributor.author | Mori, R | |
dc.contributor.author | Nishida, T | |
dc.contributor.author | Kusuda, S | |
dc.contributor.author | Nakayama, T | |
dc.date.accessioned | 2015-07-08T20:46:02Z | |
dc.date.available | 2015-07-08T20:46:02Z | |
dc.date.issued | 2015-06-15 | |
dc.identifier.issn | 2044-6055 | |
dc.identifier.issn | 2044-6055 | |
dc.identifier.other | ARTN e007135 | |
dc.identifier.uri | http://hdl.handle.net/10026.1/3413 | |
dc.description.abstract |
OBJECTIVE: To assess the validity and reliability of the Sheffield Peer Review Assessment Tool (SPRAT) Japanese version for evaluating doctors' competencies using multisource feedback. METHODS: SPRAT, originally developed in the UK, was translated and validated in three phases: (1) an existing Japanese version of SPRAT was back-translated into English; (2) two expert panel meetings were held to develop and assure content validity in a Japanese setting; (3) the newly devised Japanese SPRAT instrument was tested by a multisource feedback survey, validity was tested using principal component factor analysis, and reliability was assessed using generalisability and decision studies based on generalisability theory. RESULTS: 86 doctors who had been practising for between 2 and 33 years participated as assessees and were evaluated with the SPRAT tool. First, the doctors identified 1019 potential assessors who were each sent SPRAT forms (response rate, 81%). The mean number of assessors per doctor was 9.7 (SD=2.5). The decision study showed that 95% CIs of ± 0.5 were achieved with only 5 assessors. 85 of the 86 doctors achieved scores that could be placed with 95% CI above the 4 expected standard. Doctors received lower scores from more senior assessors (p<0.001) and higher scores from those they had known longer (p<0.001). Scores also varied with the job role (p<0.05). CONCLUSIONS: Following translation and content validation, the Japanese instrument behaved similarly to the UK tool. Assessor selection remains a primary concern, as the assessment scores are affected by the seniority of the assessor, the length of the assessor-assessee working relationship, and the assessor's job role. Users of the SPRAT tool need to be aware of these limitations when administering the instrument. | |
dc.format.extent | e007135-e007135 | |
dc.format.medium | Electronic | |
dc.language | en | |
dc.language.iso | eng | |
dc.publisher | BMJ | |
dc.subject | EDUCATION & TRAINING (see Medical Education & Training) | |
dc.subject | MEDICAL EDUCATION & TRAINING | |
dc.subject | PAEDIATRICS | |
dc.subject | Clinical Competence | |
dc.subject | Female | |
dc.subject | Formative Feedback | |
dc.subject | Humans | |
dc.subject | Japan | |
dc.subject | Male | |
dc.subject | Peer Review, Health Care | |
dc.subject | Pilot Projects | |
dc.subject | Reproducibility of Results | |
dc.title | Assessing doctors' competencies using multisource feedback: validating a Japanese version of the Sheffield Peer Review Assessment Tool (SPRAT) | |
dc.type | journal-article | |
dc.type | Journal Article | |
dc.type | Research Support, Non-U.S. Gov't | |
dc.type | Validation Study | |
plymouth.author-url | https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000363479900032&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=11bb513d99f797142bcfeffcc58ea008 | |
plymouth.issue | 6 | |
plymouth.volume | 5 | |
plymouth.publication-status | Published | |
plymouth.journal | BMJ Open | |
dc.identifier.doi | 10.1136/bmjopen-2014-007135 | |
plymouth.organisational-group | /Plymouth | |
plymouth.organisational-group | /Plymouth/Faculty of Health | |
dc.publisher.place | England | |
dc.identifier.eissn | 2044-6055 | |
dc.rights.embargoperiod | Not known | |
rioxxterms.versionofrecord | 10.1136/bmjopen-2014-007135 | |
rioxxterms.licenseref.uri | http://www.rioxx.net/licenses/all-rights-reserved | |
rioxxterms.type | Journal Article/Review |