Journal List > J Educ Eval Health Prof > v.7 > 1148856

Khan, Akturk, and Al-Megbil: Evaluation of the Learning Environment for Diploma in Family Medicine with the Dundee Ready Education Environment (DREEM) Inventory

Abstract

The primary healthcare system is at a turning point in Saudi Arabia. However, the sustainability of family medicine as the core element of that system is increasingly being called into question because of lack of family physicians. In keeping view this problem; a postgraduate diploma program in family medicine has started in 2008. A validated measure of educational environment i.e., Dundee Ready Education Environment (DREEM) questionnaire consisting of 50 questions having five domains of perception was administered to all 13 trainees of the diploma course at the completion of the program to check their perception about learning evironment. The trainees comprised of 4 males (40%) and 6 females (60%). The overall score showed more positive than negative side (147/200). There is no significant difference (P > 0.05) in the mean scores of five different domains of perception. The subclasses of five domains showed that teaching perceived as positive by 50%, moving towards right direction by 80%, feeling more positive by 50%, positive attitude by 80% and the 70% scored the course as not too bad. The overall high score and positive attitude towards the course assures the better teaching environment. However, there are areas to improve and it requires continuous evaluation.

The learning environment has its own impact on behavior of learning and a good environment enhances the ability of learning. The importance is recognized by learners and teachers. Students’ perception of the environment within which they study has been shown to have a significant impact on their behavior, academic progress and sense of well-being [1]. Nevertheless different methodologies have been applied to investigate educational environment. Among them, the recent one includes qualitative approaches [2] or the use of questionnaires [3]. However, of these, only the Dundee Ready Educational Environment Measure (DREEM) questionnaire [4] is more focused to the environment experienced by students on medical and healthcare-related courses. This tool was build up by an international Delphi panel, and has been applied to a number of undergraduate courses for health professionals worldwide. The inventory was validated by over 1,000 students world-wide and is now being used widely in order to measure and ‘diagnose’ undergraduate educational climates in the health professions, having been translated into Spanish, Portuguese, Arabic, Swedish, Norwegian, Malay and Thai and used in several settings including the Middle East [5]. It is currently being used in the UK, Canada, Ireland, Thailand, Indonesia, Malaysia, Norway, Sweden, Venezuela, Brazil, the West Indies, Sri Lanka, Oman and the Yemen.
The Ministry of Health in Saudi Arabia at centre for postgraduate studies in Family Medicine has started first time a diploma program in family medicine. It is a comprehensive 14-month’s program covering all aspects of family medicine. Initially 13-students have been enrolled and completed their studies in year 2009. In this cross sectional pilot study, all students were asked to fill the DREEM inventory; however three did not submit their questionnaires. The DREEM inventory questionnaire includes of 50 items [5], each scored 0–4 on a 5-point scale. The statements which are negative considered in reverse order, so that high scores on these items indicate disagreement will become a positive result. This questionnaire produces an overall “score” for the course and results were analyzed with Chi Square and the Mann-Whitney U test. The overall statements may also be subdivided to provide different student perceptions in the groups of 5 different aspects [6] of the educational environment:
  • Perceptions of learning

  • Perceptions of teachers

  • Academic self-perception

  • Perceptions of atmosphere

  • Social self-perceptions

The results revealed that median age of the male participants was 25.50 years (4 males) and female participants was 33 years (6 females). The perception analysis shows that 50% students perceived teaching as negative whereas 80% agreed that they are moving in a right direction (Table 1). Academic self perception shows more satisfaction as 50% feeling more on positive side. The overall perception was good. Not a single perception was scored below the 2 mean values. The overall median DREEM score was 118.5/200 (59.25%) (Table 2). There is no significant difference (P > 0.05) in the mean scores of five different domains of perception. The Table 3 highlights the rating of the students responses on 50-items individually.
So far this is the first study to report results from the complete postgraduate cohort of a diploma program for family medicine. The DREEM questionnaire has provided an overview of student opinion throughout the study period (14-months) and allowed areas of concern to be highlighted. Analysis of the identified concerns will form the basis of strategic planning in order to institute remedial action, and on which to focus institutional resources. The study shows that the perception of teachers is better than the other dimensions. One reason for this might be that the diploma program in our setting is rather new and hence, the facilities are not settled yet. However, a study at the well-settled college of medicine in King Saud University found a similar result [7], which could indicate that there are other factors beyond facilities. The overall median score being at around 60% is another indication that there is some area to improve. A study in West Mislands revealed mean DREEM scores of 70% of the total [8]. DREEM global score of a Nigerian medical school was reported as 118/200 and that of a Nepalese health professions institution was reported as 130/200 [9]. DREEM global score of the faculty of medical sciences in Trinidad was reported as 109.9 [10]. Mayya and Roff [11] reported global scores of 107.44/200 in an Indian medical school and Varma [7] reported scores of 139/200 in undergraduate schools. When compared with these figures our results demonstrate that the SDFM evaluations ranks somewhere around the average in the literature. Item-wise ratings of the two questions suggest that most aspects of the climate could be enhanced. Students in general are more critical about the quality of teaching, especially in the areas of student participation in the class, provision of clear learning objectives, course being boring, trainee centred teaching, and keeping attached to the timetable. Learning atmosphere on the other hand received higher scores. Mayya’s study revealed that students in general are more critical about the quality of teaching and the general climate of the school [10]. Continuous quality improvement and innovation are very essential in a medical school. Most researchers agree upon the usefullness of the DREEM inventory as a useful basis for strategic planning and resource utilization [7, 12]. Nevertheless, due to small sample size, the generalization of results might not be good idea however, it gives some clues or hints about the program and need to follow up for coming years. Further research on the use of DREEM inventory, comparing different diploma programs with follow up surveys, may be useful for educators to ensure and maintain high quality educational environments.

Notes

This article is available from: http://jeehp.org/

REFERENCES

1. Genn JM. AMEE Medical Education Guide no. 23 (part 2): curriculum, environment, climate, quality and change in medical education: a unifying perspective. Med Teach. 2001; 23:445–54.
2. Seabrook MA. Clinical students’ initial reports of the educational climate in a single medical school. Med Educ. 2004; 38:659–69.
crossref
3. Audin K, Davy J, Barkham M. University quality of life and learning (UNIQoLL) an approach to student wellbeing, satisfaction and institutional change. J Further High Educ. 2003; 27:365–82.
crossref
4. Roff S. The Dundee Ready Educational Environment Measure (DREEM): a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach. 2005; 27:322–5.
5. Roff S, McAleer S, Harden RM, Al-Qahtani M, Ahmed AU, Deza H, et al. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach. 1997; 19:295–9.
crossref
6. Whittle SR, Whelan B, Murdoch-Eaton DG. DREEM and beyond; studies of the educational environment as a means for its enhancement. Educ Health. 2007; 20:7.
7. Al-Ayed IH, Sheik SA. Assessment of the educational environment at the College of Medicine of King Saud University, Riyadh. East Mediterr Health J. 2008; 14:953–9.
8. Varma R, Tiyagi E, Gupta JK. Determining the quality of educational climate across multiple undergraduate teaching sites using the DREEM inventory. BMC Med Educ. 2005; 5:8.
crossref
9. Roff S, McAleer S, Ifere OS, Bhattacharya S. A global diagnostic tool for measuring educational environment: comparing Nigeria and Nepal. Med Teach. 2001; 23:378–82.
crossref
10. Bassaw B, Roff S, McAleer S, Roopnarinesingh S, De Lisle J, Teelucksingh S, et al. Students’ perspectives on the educational environment, Faculty of Medical Sciences, Trinidad. Med Teach. 2003; 25:522–6.
crossref
11. Mayya SS, Roff S. Students’ perceptions of educational environment: a comparison of academic achievers and under-achievers at Kasturba Medical College, India. Educ Health. 2004; 17:280–91.
crossref
12. Avalos G, Freeman C, Dunne F. Determining the quality of the medical educational environment at an Irish medical school using the DREEM inventory. Ir Med J. 2007; 100:522–5.

Table 1.
Perception of students
Items Frequency Percent
Perception of learning
  Teaching is viewed negatively 5 50
  A more positive perception 5 50
Perception of teachers
  Moving in the right direction 8 80
  Model course organizers 2 20
Academic self perception
  Many negative expects 4 40
  Feeling more on the positive side 5 50
  Confident 1 10
Perception of atmosphere
  There are many issues which need changing 1 10
  A more positive attitude 8 80
  A good feeling overall 1 10
Social self perception
  Not a nice place 3 30
  Not too bad 7 70
Table 2.
Median scores of different perceptions
No. Min. Max. Median 95% CI
Students’ perception of learning 10 1.58 2.92 2.08 1.81–2.51
Students’ perception of teachers 10 2.36 3.18 2.86 2.60–3.01
Students’ academic self perception 10 1.88 3.25 2.25 1.99–2.60
Students’ perception of atmosphere 10 2.00 3.17 2.50 2.22–2.82
Social self perception 10 1.29 2.86 2.50 1.91–2.68
Table 3.
Item-wise ratings of the Dundee Ready Educational Environment Measure (DREEM) questions
# Item Median score
1 Encourage to particIpate 4.00
2 Knowledgeable 3.00
3 Good support system 2.50
4 Too tired to enjoy 2.00
5 Learning strategies 3.00
6 Patiented centred approach 3.00
7 Teaching stimulating 2.50
8 Organizers ridicule 2.00
9 Organizers authritarian 1.50
10 Confident for passing year 2.00
11 Atmosphere relaxed 3.00
12 Well timetabled 1.50
13 Teaching is trainee centred 1.50
14 Rarely bored on the course 1.00
15 Good friends 4.00
16 Develop competence 2.50
17 Cheating is a problem 2.00
18 Good communication skill 3.50
19 Social life is good 3.50
20 Teaching well focussed 1.00
21 Well prepared for profession 2.50
22 Develop confidence 3.50
23 Atmosphere relaxed 4.00
24 Teaching time put to good use 2.00
25 Overemphasize factual learning 1.00
26 This year good preparation 3.00
27 Able to memorise all I need 1.50
28 Seldom feel lonely 3.00
29 Good to provide feedback 3.00
30 Opport. to develop interpersonal skills 3.50
31 Learn empathy 3.00
32 Provide constructive critism 3.00
33 Comfortable in teaching session socially 4.00
34 Atmosphere relaxed In group work 4.00
35 Experience disappointing 2.50
36 Able to coentrate well 1.50
37 Give clear examples 3.00
38 Clear about learning objectives 1.00
39 Get angry during teaching 4.00
40 Well prepared for teaching 4.00
41 Problem solving skill improved 2.00
42 Enjoyment outweigh the stress 1.50
43 Atmosphere motivates 2.00
44 Active learner 3.00
45 Relevant to career 3.00
46 Accomodation pleasant 2.50
47 Ltl is emphasized over stl 3.50
48 Too teacher centred 2.50
49 Ask the question 4.00
50 The trainee irritate the organizers 0.00
TOOLS
Similar articles