Journal List > Perspect Nurs Sci > v.11(2) > 1060391

Iikura and Suh: Comparison of Teacher's and Students' Evaluations on OSCE Performance among College Nursing Students

Abstract

Purpose

This study was aimed to compare and contrast the evaluation scores on students OSCE performance between the instructors and students according to the Bloom's taxonomy.

Methods

A total of sixty six students in a nursing college in Seoul, Korea and four instructors were recruited in the study. The 28 sophomore students were assigned to an OSCE on intravenous injection, whereas 38 junior students on tracheostomy care. Knowledge levels were measured by the students using the researcher developed knowledge questionnaires, and the attitudes and skills by the students and instructors by the modified clinical performance checklists. The data were analyzed by SPSS 22.0 program.

Results

For knowledge, the higher GPA of the previous semester was only significant factor of higher knowledge scores. There were statistically significant differences in scores of total (t=-2.740, p=.008) and skill (t=-2.528, p=0.014), but not in attitude between the instructors and students' evaluations. The students evaluated their skill scores significantly higher than those of the instructors. For knowledge, the higher GPA of the previous semester was the only significant factor of higher knowledge scores. In attitude scores, the students in higher grade significantly overestimated themselves (t=3.076, p=.003).

Conclusion

Clinical performance assessment requires methodological validity and reliability for student to attain necessary clinical skills properly and efficiently. The findings of this study mandate various assessment methods for nursing simulation evaluations to be valid.

REFERENCES

1. Japanese Ministry of Health Law. Study report on the role of technical education in basic nursing education. 2003. [cited 2014 March 23]. Available from:. http://www.mhlw.go.jp/shingi/2003/03/s0317-4.html.
2. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975; 1:447–51.
crossref
3. Kajita E. Kyouiku hyouka dai (Education evaluation). 2nd ed.Tokyo, Japan: YuhikakuSousho;2010.
4. Takahashi A, Arita K, Kuratani N, Imaizumi K, Taniyama M, Ito Y. Jyomyakuketsusaiketsu' ensyuniokerugakusei' kyouin-kan no hyouka no hikaku(A comparison of students' and teacher' evaluation on simulation practice of collecting blood). Bull Kawasaki City Coll Nurs. 2007; 12:9–15.
5. Nakamura K. Kango OSCE (Nursing OSCE). Tokyo. Japan: Medical-friend Sha;2011.
6. Kinoshita Y, Kawakami C. Literature review on evaluation of goal achievement in clinical nursing practice. Memoirs Department of Health Science School of Medicine Kyushu University. 2007; 8:49–58.
7. Sugimori M, Funashima N. Kango Kyouiku (Nursing Education). Tokyo. Japan: IgakuShoin;2012.
8. Han MH, Park SG. Differences between scores assessed by examiners and examinees on objective structured clinical examination. Korean J Med Educ. 2009; 21:279–85.
crossref
9. Han MH, Park SG. Analysis of trends in self-assessment of performance of clinical skills in nursing students after OSCE. J Korean Acad Fundam Nurs. 2011; 18:210–6.
10. Tajima K. Kangogakukyouikuhyouka no kiso to jissai-kango-jissennouryokuikuseinojyujitunimukete (Fundamental and practice of education evaluation of nursing-for fruitful upbringing of nursing competence). Tokyo. Japan: IgakuShoin;2011.
11. Abadel FT, Hattab AS. How does the medical graduates' self-assessment of their clinical competency differ from experts' assessment? BMC Med Educ. 2013; 13(24):1–9. http://dx.doi.org/10.1186/1472-6920-13-24.
crossref
12. Baxter P, Norman G. Self-assessment or self deception? A lack of association between nursing students' self-assessment and performance. J Adv Nurs. 2011; 67:2406–13. http://dx.doi.org/10.1111/j.1365-2648.2011.05658.x.
crossref
13. Corcoran AM, Lysaght S, LaMarra D, Ersek M. Pilot test of a three-station palliative care observed structured clinical examination for multidisciplinary trainees. J Nurs Educ. 2013; 52:294–8.
crossref
14. Paul F. An exploration of student nurses' thoughts and experiences of using a video-recording to assess their performance of cardiopulmonary resuscitation (CPR) during a mock objective structured clinical examination (OSCE). Nurs Educ Pract. 2010; 10:285–90.
crossref
15. White CB, Ross PT, Gruppen LD. Remediating students' failed OSCE performances at one school: The effects of self-assessment, reflection, and feedback. Acad Med. 2009; 84:651–4.
crossref
16. Blanch-Hartigan D. Medical students' self-assessment of performance: Results from three meta-analyses. Patient Educ Couns. 2011; 84:3–9. http://dx.doi:10.1016/j.pec.2010.06.037.
crossref
17. Kruger J, Dunning D. Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999; 77:1121–34.
crossref
18. Hodges B, Regehr G, Martin D. Difficulties in recognizing one's own incompetence: Novice physicians who are unskilled and unaware of it. Academic Medicine. 2001; 76:S87–9. http://dx.doi.org/10.1097/00001888-200110001-00029.
19. Parker RW, Alford C, Passmore C. Can family medicine residents predict their performance on the in-training examination? Fam Med. 2004; 36(10):705–9.
20. Roter DL, Larson S, Shinitzky H, Chernoff R, Serwint JR, Ada-mo G, et al. Use of an innovative video feedback technique to enhance communication skills training. Med Educ. 2004; 38(2):145–57.
crossref
21. Uchida R, Tsuchiya Y, Akahoshi N, Yamada M, Ogata S, Oku S. On trial of objective structured clinical examination in adult nursing. South Kyusyu J Nurs. 2008; 6:55–61.
22. Japan Youth Research Institute. Koukouseino kokoroto kara-dano kenkouni kansuru chousa (Research on the health of body and mind in high school students). 2012. [cited 2014 March, 20]. Available from:. http://www1.odn.ne.jp/~aaa25710/reserch/2011/gaiyo.pdf.

Table 1.
Demographic Characteristics of the Participants (N=66)
Characteristics Categories n (%) or M±SD
Age (year) 21.1±1.93
Gender Male 12 (18.2)
Female 54 (81.8)
Grade 2nd 28 (42.4)
3rd 38 (57.6)
GPA of nursing major subjects ≥A0 6 (9.1)
A-~B+ 32 (48.5)
B0~B- 25 (37.9)
≤C+ 3 (4.5)
GPA of clinical practice ≥A0 10 (15.2)
A-~B+ 38 (57.6)
B0~B- 15 (22.7)
≤C+ 3 (4.5)
Simulation experience Yes 56 (84.8)
No 10 (15.2)
Number of simulation experience 2.12±3.71
Type of simulation experience HPS 20 (30.3)
Task trainer 51 (77.3)
Role play 14 (21.2)
Patient 12 (18.2)
Others 1 (1.5)
Number of practice 2.50±2.47

GPA=Grade point average; HPS=Human patient simulator.

Table 2.
Measured Scores and Gaps between the Instructors and the Students
Variables Categories M±SD Difference t p
Skills Instructor's 69.24±8.87 -2.21 -2.528 .014
Student's 71.45±7.40
Attitudes Instructor's 20.66±4.13 -0.96 -1.473 .146
Student's 21.63±5.72
Total Instructor's 89.90±11.59 -3.36 -2.740 .008
Student's 93.27±11.82
Table 3.
Influencing Factors of the Differences in Knowledge Scores and the Gaps between Instructor's and Student's Evaluations on Skill and Attitude Scores
Factors Knowledge Skills Attitude Total Scores
t or F (p) t or F (p) t or F (p) t or F (p)
Gender -0.803 (.425) -0.917 (.363) -0.081 (.936) -0.712 (.479)
Grade 1.000 (.000) -3.102 (.003) 3.076 (.003) -0.659 (.512)
GPA of nursing majors 5.302 (.003) 2.591 (.061) 0.119 (.948) 1.202 (.317)
GPA of clinical practicum 1.540 (.213) 0.915 (.439) 4.516 (.006) 1.669 (.183)
Simulation experience -1.866 (.067) -1.721 (.090) -0.044 (.965) -1.268 (.210)
Practice experience -0.620 (.537) -1.495 (.140) -0.368 (.714) -1.290 (.202)
Number of practice 0.183 (.856) -0.734 (.466) -2.668 (.010) -1.980 (.052)
Z score of exam - 0.865 (.390) 0.548 (.586) 0.934 (.354)
Z score of skill 0.173 (.863) 2.821 (.006) 1.156 (.252) 2.712 (.009)
Z score of attitude -0.106 (.917) 0.894 (.375) 4.767 (.000) 3.397 (.001)

GPA=Grade point average.

TOOLS
Similar articles