Abstract
Purpose
It aimed at describing the perception of the clinical educational environment by physiotherapy students based on the Postgraduate Hospital Educational Environment Measurement Questionnaire in Chile.
Methods
The clinical education environment was evaluated according to the Postgraduate Hospital Educational Environment Measure (PHEEM) by 192 students originally enrolled in the fifth year of the physiotherapy career at 3 different headquarters of the academic institution: Santiago, Viña del Mar, and Concepcion Campus (Metropolitan, Valparaiso, and Bio Bio region, respectively), from March to October 2018. The Cronbach’s α was applied to measure the reliability of the instrument and the Student-t and analysis of variance tests were used to compare the differences of PHEEM scores by headquarters, environmental areas, and experience of internship.
Results
A total overall average score of 125.88 was obtained, which meant an excellent educational environment. The overall score was 127.6±22.7 for headquarters 1, 125.6±21.6 for headquarters 2, and 122.5±26.9 for headquarters 3. According to the type of establishment, the scores were of 127.1±22.1 for private and 123.5±26.3 for public institutes. According to the type of area, the score was cataloged as an excellent educational environment in all cases, except in the respiratory care area (lowest score, 117.5±29.1). Finally, the score was 126.9±20.5 for the first internship, 121.7±29.3 for the second, and 129.4±19.6 for the third.
Conclusion
There is relative homogeneity of the clinical educational environment for different headquarters, types of establishment, or type of area; but there are significant differences in the number of the internship. The promotion of a good clinical educational environment can have an important impact on the development and performance of the future professional, being the detection of negative aspects an opportunity to improve the hidden curriculum.
Is highly accepted that the educational environment has a strong influence on the learning process, social life, and future work. The performing of the educational environment includes a great variety of factors such as student welfare, the quality of teaching, the curriculum, the perception of academic achievement, the number of learning opportunities, facilities available, and others which together attribute to each educational institution a differentiating aspect [1].
Students’ perceptions of the educational environment play a decisive role in the planning and implementation of a curriculum. It also helps stakeholders and the schools themselves to reflect, reform, and remedy to make the curriculum friendly for students without compromising or detracting from the standards and quality of the teaching-learning process [2]. Therefore, feedback and systematic evaluation are vital for the successful management of the curriculum. The evaluation of the environment in contexts of practical courses, which usually have many more variables to consider, may help to solve educational problems and improve the effectiveness of the process [3]. According to the study of Fuenzalida et al. [4], the evaluation of the clinical educational environment contributes to identify the main strengths and aspects that may be improved, which also serve as the basis for developing a future action plan that could directly benefit students, academics, and other stakeholders. This understanding about that the educational perception is a reflective observation of the student about his educational environment and that can help to optimize the environment is vital and an important contribution for the measurement to be considered part of the internal self-evaluation process for each career and also a contribution to the accreditation process [5].
There are many instruments have been translated from the English and subsequently validated to other different languages, being reflect of the interest and relevance of the continuous evaluation of the educational environment for the academic community [6], a trend based on the need to obtain objective measures supporting education based on results [6]. In the clinical field, questionnaires such as the Postgraduate Hospital Educational Environment Measure (PHEEM) have been created, which one was originally manufactured for the medical career and with language adaptation for their own specialties [7]. There is no specific instrument of evaluating educational environment created for rehabilitation careers, for example, physiotherapy. It is recognized that a wide knowledge of the educational environment facilitates the possibilities of approach, allowing a better evaluation of one of the many aspects present in the academic formation. For this reason, the objective of this study was to describe the physiotherapy students’ perception of educational clinical environment by adopting the PHEEM Questionnaire.
The Institutional Ethical Committee at Universidad de las Américas approved the study protocol (UA126). The informed consent was contained in the questionnaire form.
The PHEEM Questionnaire has shown to have good psychometric results of validity and reliability [8]. The original instrument consists of 40 items, contains 36 positive affirmations, and 4 negative ones. It has a scale from ‘totally in disagreement’ to ‘totally agree,’ with a score of 0 to 4 on a Likert scale, grouped into 3 subscales for perceptions of role autonomy, teaching, and social support. The translation and validation used as the basis for this study, retains the same characteristics of the original, but with modifications in technical concepts typical of the physiotherapy career. This adaptation was made with the supervision, suggestions, and authorization of the original authors (Tables 1, 2). The higher the score, the better the perception of the clinical educational environment.
A total of 419 questionnaires were obtained from 192 students originally enrolled in the fifth year of the physiotherapy career at 3 different headquarters of the academic institution: Santiago, Viña del Mar, and Concepcion Campus (Metropolitan region, Valparaiso region, and Bio Bio region, respectively). The number of interns varied in each internship due to situations typical of the progression in the curriculum of a student. The questionnaire was applied in 3 internships of the professional practical subject, in the last week of each one (from March to October 2018). These internships do not have a specific thematic area in order, they are assigned at random. The only requirement is to incorporate an internship in each discipline area of their clinical training. The questionnaire was administered through web-based form, which also where students allowed the use of the data voluntarily, anonymously, and confidentially.
The original scale of interpretation of results was used [8]. The PHEEM Questionnaire can also be used to pinpoint more specific strengths and weaknesses within the educational climate and to do this one needs to observe at the responses to individual items, but it was not the aim of the study. The Cronbach’s α was calculated to evaluate the internal consistency of the PHEEM Questionnaire results, for both the total mean. Descriptive measures were obtained for each domain of the scale and the results were stratified by internship number, headquarter, and type of area. The Kolmogorov-Smirnov test was used to evaluate the normality of the data. Analysis of variance (one-way analysis of variance test) and mean comparison (Student t-test) was used to determine the significance of differences among internship number, headquarter, and type of area, with a level of significance set at P<0.05. Descriptive analysis was performed to calculate the mean score for each item; these item scores were then used to identify problem areas as a whole and by the number of internships. Descriptive and inferential analysis was performed using IBM SPSS ver. 21.0 (IBM Corp., Armonk, NY, USA).
We received 419 completed questionnaires. The PHEEM Questionnaire adapted for the physiotherapy career obtained a Cronbach’s α of 0.90, proving to have excellent reliability. The raw data are available in Supplement 1.
The overall perception of the clinical educational environment had a score of 125.9±23.6 (excellent educational environment), the perception of the role of autonomy was 35.7±5.9 (a more positive perception of the role of each), the perception of teaching quality was 51.7±11.8 (model teachers), and social support was 31.1±6.3 (more pro than contras). Descriptive summaries in Table 3.
When comparing the results according to the number of the internship, the number of responses was homogeneous for the descriptive measures. The overall score decreased from the first to second internship and then increased from the second to the third internship, the latter being the highest score of the three and the second the lowest. This occurs in all domains of the questionnaire (Table 3). The differences were statistically significant in the overall score and all its domains (P<0.05) (Table 4).
Regarding headquarters, there are differences in the descriptive measures obtained, but they were not statistically significant in any of the domains (Table 4). The overall score was 127.6±22.7 for headquarters 1, 125.6±21.6 for headquarters 2, and 122.5±26.9 for headquarters 3, all of which were classified as having an ‘excellent educational environment’ (Table 3).
When comparing the types of establishment, the overall scores were 127.1±22.1 for private and 123.5±26.3 for public, the environments of both types of establishments were cataloged with an ‘excellent educational environment’ (Table 3). The differences were not statistically significant in any of the domains (Table 4).
When comparing the environment in the different areas of sanitary rehabilitation, the overall score was cataloged as an ‘excellent educational environment’ in all cases, except in the ‘Sala ERA’ (respiratory care room; lowest score, 117.5 ±29.1; educational environment more positive than negative with space for improvement). The highest score was found in ‘MAS program’ (care of self-heating elderly people) with 135±16.9 (Table 3). The differences were not statistically significant in any of the domains (Table 4); however, the fact of the homogeneity of distribution of responses must be considered (Table 4).
This study was conducted to describing the perception of the clinical educational environment by physiotherapy students based on the Postgraduate Hospital Educational Environment Measurement Questionnaire in Chile.
A relative homogeneity of the results was found with similar scores for the different sites, types of establishment, or rehabilitation areas. But, there are significant differences in the number of internships, showing an increase in the score as they advance, therefore, improve the perception of the clinical educational environment. This, could reflect the perception of preparation and accommodation on the part of the students to face the changes of scenarios [9], something that is also consistent with the progression of the stages declared in the course’s own program of the race where this study was implemented (stage 1, introduction to the service; stage 2, introduction to the professional role; stage 3, empowerment of the professional role; and stage 4, autonomy of the professional role), which speak of a progression in the time the practice is developed and where the student is expected to acquire challenges and graduated activities, being evaluated as expected in each of the cycles. The variation of the score on this subscale could also be supported by the empirical evidence that indicates that students initiate a training program with a higher expectation of their educational learning environment are likely to have more general perceptions of an environment throughout the course of the course of the program [10].
The literature has reported variations depending on the type of clinical internship attended by the student and the type of training institution in which he performs his training [11]. Galli et al. [12] mention that the perception of the interns is less favorable in the public sector. In Chile, there is a public regulatory framework that could present deficiencies. It is the National Teaching Assistance Commission (CONDAS) that defines the clinical field as a healthcare facility with adequate conditions of structure, personnel, and equipment and it commits to promote the advancement of the disciplinary and generic competences defined by health careers for its graduates [13]. In more qualitative analysis, Galli et al. [12], mention aspects that make the difference are: having a continuous clinical supervision, having the conditions in the health facilities of work and rest, feeling the sensation of physical security within the establishment, and having the flow adequate daily attendance with respect to the time of permanence in practice [14]. Due to the influence that the indicated legal and administrative changes can have on the interrelation of teaching care in the public sector, it is fundamental that the state organisms and training centers are able to assume shared responsibilities for a better understanding of the problems that arise in the development of the practices.
The general result of the questionnaire was an ‘excellent educational environment’ in each internship (first, second, and third) carried out by the intern. However, when observing the type of area, the ‘Sala ERA’ (respiratory care room) has a lower average score than the rest and outside the maximum range of interpretation of the scale. When observing the scores of the domains, the social support is under the maximum range, which shows the possibility of improving some points with respect to the conditions of the centers where these presses are developed.
The perception domains of the clinical educational environment for the quality of education and global scoring were within maximum ranges, but not for the role of autonomy and social support, so there is space for improvement for both aspects considering that the first could depend more on intrinsic characteristics of the intern and the second one, could depend on external factors. The global score could be due to recent curricular modification by the career that deepens the educational model of the institution centered on the student, seeking to prepare it to achieve an autonomous role of the profession gradually by facilitating the sense of identity, generation of habits, and norms that specify the institutional culture based on the values of professional ethics, civic responsibility, and community commitment. In any case, Quiroga-Maraboli et al. [15] recommends complementing the findings of the different questionnaires that evaluates the perceptions of the educational environment with a qualitative study to explore the current context and to propose potential solutions to the problematic subscales or each element.
For the autonomy role, the results seem to be consistent with other investigations where the internal or resident students have experienced personal growth as time goes by in their practice activities [12]. According to Clouder and Adefila [14], the level of confidence of the student is associated with the ability to learn to the extent that they are empowered to assume increasing levels of responsibility, and that this in turn depends to a large extent on active participation in that practice [16]. Clinical supervision is an important factor to avoid the fluctuating self-confidence that students refer to move towards autonomous practice [17].
Though this study has some limitations, for example having sample from one specific region from Latin America and only from one educational institution thus difficult to generalize for the others that could be addressed to some extent by comparison of the results with other studies. However, it is suggested to conduct the similar study on a large scale and covers as many as possible regions and schools from physiotherapy.
We do not declare demographic variables such as sex, age, and cultural background, which could be considered an inconvenience. However, the purpose of the study was to describe the perception of the clinical educational environment by physiotherapy students based on the Postgraduate Hospital Educational Environment Measurement Questionnaire as an approach to the diagnosis and use it as one of the improvement materials of the same and other areas of the career curriculum.
The students are a pertinent source of information. However, the perception of the educational environment among different groups of students is idiosyncratic and may differ widely from 1 year to the next, so a cohort follow-up would be necessary. Likewise, it is necessary to be clear about which students are only one part of the educational scenario, so that the perceptions of teachers and other stakeholders are equally important. Future studies may be focused in the multipart that make up the clinical education environment.
To conclude, we believe that the measurement of the clinical educational environment should be recognized as an important edge in the self-assessment process of careers and institutions to assess the impact of changes in clinical practice and curricular innovation processes. Considering other studies that have also used this questionnaire, we emphasize that it should be used in its original format with the 40 basic questions to allow comparisons between programs and allow evaluations of the 3 domains during the different phases of the professional practice, considering the adaptations of technical language for each health discipline.
Notes
References
1. Hinrichs CP, Ortiz LE, Perez CE. Relation between academic welfare of physical therapy students of a traditional university of Chile and their perception of the educational environment. Form Univ. 2016; 9:109–116. https://doi.org/10.4067/s0718-50062016000100012.
2. Mojaddidi MA, Khoshhal KI, Habib F, Shalaby S, El-Bab ME, Al-Zalabani AH. Reassessment of the undergraduate educational environment in College of Medicine, Taibah University, Almadinah Almunawwarah, Saudi Arabia. Med Teach. 2013; 35 Suppl 1:S39–S46. https://doi.org/10.3109/0142159X.2013.765554.
3. Walankar P, Panhale V, Situt S. Students’ perception of the educational environment in an Indian physiotherapy college. Internet J Allied Health Sci Pract. 2019; 17:Article 1.
4. Fuenzalida B, Pizarro M, Fuentes J, San Martin C, Rojas V, Lopez-Fuenzalida A, Padilla O, Riquelme A. Educational environment perception in physiotherapy undergraduate students: mixed methodology. Educ Med. 2018; Jul. 20. [In press]. https://doi.org/10.1016/j.edumed.2018.05.010.
5. Aghamolaei T, Fazel I. Medical students’ perceptions of the educational environment at an Iranian Medical Sciences University. BMC Med Educ. 2010; 10:87. https://doi.org/10.1186/1472-6920-10-87.
6. Dominguez LC. Tools for the evaluation of learning climate in posgraduate training: Synthesis of evidence in the light of psychometric definitions. Educ Med. 2018; 19(Suppl 3):335–349. https://doi.org/10.1016/j.edumed.2017.10.015.
7. Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach. 2005; 27:326–331. https://doi.org/10.1080/01421590500150874.
8. Ahmed R, Farooq A, Storie D, Hartling L, Oswald A. Building capacity for education research among clinical educators in the health professions: a BEME (Best Evidence Medical Education) systematic review of the outcomes of interventions: BEME guide no. 34. Med Teach. 2016; 38:123–136. https://doi.org/10.3109/0142159X.2015.1112893.
9. Footer CB, Tsegaye HS, Yitnagashaw TA, Mekonnen W, Shiferaw TD, Abera E, Davis A. Empowering the physiotherapy profession in Ethiopia through leadership development within the doctoring process. Front Public Health. 2017; 5:51. https://doi.org/10.3389/fpubh.2017.00051.
10. Palmgren PJ, Sundberg T, Laksov KB. Reassessing the educational environment among undergraduate students in a chiropractic training institution: a study over time. J Chiropr Educ. 2015; 29:110–126. https://doi.org/10.7899/JCE-14-37.
11. Vieira JE. The postgraduate hospital educational environment measure (PHEEM) questionnaire identifies quality of instruction as a key factor predicting academic achievement. Clinics (Sao Paulo). 2008; 63:741–746. https://doi.org/10.1590/s1807-59322008000600006.
12. Galli A, Brisson ME, Soler C, Lapresa S, Alves de Lima A. Assessment of educational environment in cardiology residencies. Rev Argent Cardiol. 2014; 82:396–401. https://doi.org/10.7775/rac.es.v82.i5.3875.
13. Ministry of Health of Chile. Exempt resolution 406 of 2002 (March 7): general administrative regulation: regulations on the allocation and use of clinical fields in health services [Internet]. Santiago: Ministry of Health of Chile;2002. [cited 2019 Mar 9]. Available from: https://goo.gl/QJ9Kw1.
14. Clouder L, Adefila A. Empowerment of physiotherapy students on placement: the interplay between autonomy, risk, and responsibility. Physiother Theory Pract. 2017; 33:859–868. https://doi.org/10.1080/09593985.2017.1357153.
15. Quiroga-Maraboli P, Antunez-Riveros MA, Aguirre-Jerez M, Saldana AB, Peralta-Camposano J, Bahillo MP. Perceptions of the educational environment among undergraduate physical therapy students in a competency-based curriculum at the University of Chile. J Educ Eval Health Prof. 2019; 16:9. https://doi.org/10.3352/jeehp.2019.16.9.
16. Delany C, Bragge P. A study of physiotherapy students’ and clinical educators’ perceptions of learning and teaching. Med Teach. 2009; 31:e402–e411. https://doi.org/10.1080/01421590902832970.
17. Sobral D. Medical students’ motivation for teaching. Clin Teach. 2016; 13:313. https://doi.org/10.1111/tct.12493.
Table 1.
Table 2.
Table 3.
PHEEM, Postgraduate Hospital Educational Environment Measure; Min, minimum value found; Max, maximum value found; Mean, arithmetic mean value of the sample; SD, standard deviation of the sample; Sala CCR, community rehabilitation center for neuromusculoskeletal diseases; Sala ERA, chronic respiratory care room for adults; Sala IRA, acute respiratory infections care room in children; RBC, community-based rehabilitation; MAS, health promotion program for the elderly.
Table 4.
Domain of the survey | No. of partnership | Headquarters | Type of establishment | Type of area |
---|---|---|---|---|
Perceptions of role autonomy | 0.006* | 0.184 | 0.465 | 0.255 |
Perceptions of teaching | 0.001* | 0.149 | 0.203 | 0.104 |
Perceptions of social support | 0.002* | 0.103 | 0.055 | 0.087 |
Global score | 0.001* | 0.189 | 0.15 | 0.107 |