Show simple item record

AuthorWilby K.J.
AuthorGovaerts M.J.B.
AuthorDolmans D.H.J.M.
AuthorAustin Z.
Authorvan der Vleuten C.
Available date2020-03-18T10:47:14Z
Publication Date2019
Publication NamePatient Education and Counseling
ResourceScopus
ISSN7383991
URIhttp://dx.doi.org/10.1016/j.pec.2019.01.018
URIhttp://hdl.handle.net/10576/13402
AbstractObjective: To quantitatively estimate the reliability of narrative assessment data regarding student communication skills obtained from a summative OSCE and to compare reliability to that of communication scores obtained from direct observation. Methods: Narrative comments and communication scores (scale 1 5)were obtained for 14 graduating pharmacy students across 6 summative OSCE stations with 2 assessors per station who directly observed student performance. Two assessors who had not observed the OSCE reviewed narratives and independently scored communication skills according to the same 5-point scale. Generalizability theory was used to estimate reliability. Correlation was used to evaluate the relationship between scores from each assessment method. Results: A total of 168 narratives and communication scores were obtained. The G-coefficients were 0.571 for scores provided by assessors present during the OSCE and 0.612 for scores from assessors who provided scores based on narratives only. Correlation between the two sets of scores was 0.5. Conclusion: Reliability of communication scores is not dependent on whether assessors directly observe student performance or assess written narratives, yet both conditions appear to measure communication skills somewhat differently. Practice implications: Narratives may be useful for summative decision-making and help overcome the current limitations of using solely quantitative scores.
Languageen
PublisherElsevier Ireland Ltd
SubjectAssessment
Communication
Medical education
Pharmacy education
TitleReliability of narrative assessment data on communication skills in a summative OSCE
TypeArticle
Pagination1164-1169
Issue Number6
Volume Number102
dc.accessType Abstract Only


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record