Article Text

PDF

Series on education
Impact on medical students of incorporating GALS screen teaching into the medical school curriculum
  1. R A Foxa,
  2. J E Dacrea,
  3. C L Ingham Clarkb,
  4. A D Scotlandc
  1. aCentre for Health Informatics and Multiprofessional Education (CHIME), Royal Free and University College, Medical School, London UK, bThe Whittington Hospital, London UK, cChelsea and Westminster Hospital, London UK
  1. Dr R Fox, CHIME, Royal Free and University College Medical School, University College London, Centre For Health Informatics and Multiprofessional Education, 4th Floor Holborn Union Building, The Archway Campus, Highgate Hill, London N19 3UA, UK Email:r.fox{at}chime.ucl.ac.uk

Abstract

OBJECTIVE To assess the impact of GALS locomotor screen teaching to all 3rd year medical students, at a British medical school.

METHOD In 1998, during their 3rd year, all students were taught the GALS screen in a one hour small group session. At the end of this year, 242 medical students undertook a 16 station Objective Structured Clinical Examination (OSCE). One station assessed the locomotor screening examination, while six stations assessed the examination of other systems. The students completed a five point likert scale, self rating their confidence in each of the skills assessed at this time. Pre-registration house officers (PRHOs) at two London hospitals were invited to undertake the same OSCE and self rating.

RESULTS The students performed the locomotor screen well (mean station score 80%). Three body systems were examined better and one significantly worse (p<0.05). 22/40 PRHOs undertook the assessment. Compared with the students they examined the locomotor system (mean score 20%, p<0.001), but not other systems, less well. The PRHOs felt less confident (p<0.05) examining the locomotor system (mean rating 3.6/5) than the other systems (mean rating 4.6/5), while no significant difference in confidence ratings was seen for the students.

CONCLUSION Students who are taught the GALS screen as part of the curriculum, perform it well in an end of year OSCE, as confidently as other systems, and to a higher standard than PRHOs. Further study is required to determine whether this benefit persists, overcoming the poor skills and confidence in locomotor examination of existing PRHOs, not previously taught a GALS screen.

  • GALS
  • medical students
  • pre-registration house officer
  • OSCE

Statistics from Altmetric.com

Musculoskeletal disorders are commonly seen in general practice1 and in hospital inpatients.2 3Junior doctors appear to be poor at detecting such disorders, and it has been suggested that this is owing to a combination of poor skills and their failure to assess the locomotor system in general medical patients.2-5

Traditionally, medical students have seen the locomotor system as complex and difficult to examine. The GALS locomotor system screen5 is a quick, easy to perform, sensitive indicator of locomotor abnormality6 and has been shown to be a reliable and valid measure of functional ability.7 It can be quickly learnt by undergraduates5 and postgraduates.8 The General Medical Council of Great Britain gives a high priority to the acquisition of basic clinical skills9 and it has been suggested that the GALS screen should be included in the undergraduate curriculum5 in the UK.

The impact of teaching the GALS screen routinely as part of the curriculum has not formally been evaluated. We have examined the effect of GALS screen teaching to all 3rd year University College London medical students by incorporating it into an end of year summative assessment, which is mandatory for all these students. There are three main questions addressed: Are these students learning the GALS screen? How do they perform this screen compared with their ability to examine other body systems? How able are existing pre-registration house officers to perform a locomotor examination?

Method

MEDICAL STUDENTS

All 3rd year medical students at University College London medical school, UK, are now taught the GALS screen. This consists of two screening questions: “Do you have any pain or stiffness anywhere?” and “Do you have any difficulty washing, dressing, or climbing stairs/steps?” as well as the 11 examination tasks shown in table 2. This teaching session takes place during their general practice or rheumatology firm attachment, which may occur anytime between October and July of an academic year depending on when the student is allocated to these two firms (students rotate every six weeks). The GALS teaching typically is incorporated into part of a one hour small group session. Those 242 medical students completing their third year in July 1998, undertook a 16 station Objective Structured Clinical Examination (OSCE) of basic clinical skills at this time.

Table 2

Comparison of pre-registration house officers (PRHOs) and medical students in performing a screening locomotor examination

The students were asked to complete a named questionnaire rating their confidence in examining each of the body systems assessed in the OSCE on a five point likert scale (ranging from not at all (1) to very (5)). The rating questionnaire was completed immediately before or immediately after the OSCE (before any exam feedback).

PRE-REGISTRATION HOUSE OFFICERS (PRHOS)

The 40 PRHOs working at the Chelsea and Westminster and Whittington hospitals during July 1998 were invited to undertake the same OSCE as the medical students. Participation was voluntary and was part of a larger study looking at PRHO clinical skills. Immediately before the OSCE the PRHOs completed the same questionnaire as the students, asking them to rate their confidence in the physical examination skills to be assessed. The PRHOs had all been taught rheumatology as undergraduates but had not been taught the GALS screen specifically.

OSCE

An OSCE is a carousel, made up of clinical tasks or “stations”, and has been shown to be a good test of clinical competence.10 In this OSCE each station typically lasted for five minutes, during which the student was given written instructions for a standardised task. The student then performed the task (for example, taking a short history from a patient or examining the patient) while an observer rated his performance against a standardised marking schedule. After completing a station the student went to the next one assessing a different task. The observers were mostly clinicians or, in some cases, nurses. Rheumatology consultants or specialist registrars marked the GALS screen station. In order for all the students to undertake the OSCE, the same 90 minute circuit was run concurrently four times a day for two days at two different sites. The observers were trained for 45 minutes on the part of the OSCE circuit in which they were involved. Seven of the 16 OSCE stations assessed the examination of body systems, including one asking the candidates to “perform a screening locomotor system examination (for example, GALS) on a patient complaining of joint pain and stiffness”. Each station consisted of 9–13 items, each of which is marked pass (1 mark)/fail or not done (0 marks). A total mark for each station was obtained by standardising item scores to give a maximum mark of 20 for each station. Each OSCE station was also marked with a global score (fail/borderline fail/borderline pass/pass), for which the examiner used his judgment of overall performance irrespective of the item score.

STATISTICS

The data were analysed using SPSS for MS windows. The data rendered non-parametric testing most appropriate to compare groups for significant differences. The Wilcoxon paired rank sum test was used to compare the performance of medical students on different OSCE stations and their confidence ratings. A Mann-Whitney U test was used to compare PRHO and medical student performance. A Bonferroni correction was used where multiple comparisons were performed.

Results

22/40 PRHOs and 242 medical students undertook the OSCE. All PRHOs and 196 (81%) medical students completed the confidence rating questionnaire.

ARE THE STUDENTS LEARNING TO PERFORM THE GALS SCREEN?

The medical students performed the screening locomotor system examination well, achieving a mean score of 16 (80%), which is similar to the overall mean mark for all 16 stations (78%).

COMPARISON OF MEDICAL STUDENT GALS SCREEN PERFORMANCE WITH THAT OF OTHER SYSTEMS EXAMINATION

Table 1 compares the performance of the GALS screening examination with that of the six other physical examination stations. Friedman's two way analysis of variance test suggests there are differences in the mean marks of the physical examination stations (p<0.001). The GALS screen station results were significantly better than peripheral pulse examination, though not quite as good as respiratory/abdominal examination or blood pressure measurement (p<0.05 with Bonferroni correction). There were no significant differences between the performance of the GALS screen and neurological or higher mental function examination.

Table 1

Performance of 242 medical students on the seven physical examination OSCE stations

The medical students felt as confident examining the locomotor system (mean self confidence rating 3.9 (SD 0.9)) as other body systems (mean self confidence rating 3.9 (SD 0.6)). There was no significant difference in overall OSCE performance of medical students who did/did not complete the confidence questionnaire.

PRHO SCREENING LOCOMOTOR SYSTEM EXAMINATION SKILLS

Unlike the medical students, the PRHOs felt significantly less confident (Wilcoxon paired rank sum test, p<0.05) examining the locomotor system (mean self confidence rating 3.6 (SD 1.1)) than other body systems (mean self confidence rating 4.6 (SD 0.5)). The PRHOs performed better than the students overall in the six other physical examination stations, though this did not reach significance (mean score 86% v 82% respectively, p>0.05) but significantly worse in the locomotor examination screen (5 (20%)v 16 (80%), p<0.001). Table 2 shows the difference in PRHO and student performance for each of the 11 items assessed at the locomotor screening examination station. 88% of students and 0% of PRHOs achieved a pass/borderline pass for this station. Examiner feedback suggested that the PRHOs had little idea of how to examine the locomotor system.

OSCE

The overall reliability of the 16 station OSCE was 0.65 (Cronbach α). There was no significant difference in the overall OSCE mark or the overall mark for the six physical examination stations (excluding the GALS screen) according to the site or the date of the OSCE. Students undertaking the OSCE on day 2 of testing had a slightly higher mean GALS screen station mark than those on day 1 (16.0v 15.0, p<0.001), but there was no significant difference in scores between the two examination sites.

Discussion

GALS screen teaching during the 3rd year results in medical students performing a locomotor screening examination well in an end of year OSCE with a mean score 16 (80%). This is similar to their ability to perform an examination of other body systems. The medical students felt as confident examining the locomotor system as the other body systems.

The PRHOs performed a screening locomotor examination badly, and none of them achieved a pass/borderline pass on this station. A global score was included to ensure that the PRHOs were not examining the joints well without adhering to a GALS-like protocol— in reality, from both the item and global scores, as well as the examiners' comments, the PRHOs had little idea how to examine the locomotor system. The PRHOs performed better (though this did not reach statistical significance) in the other physical examination stations, suggesting that this is a specific deficit in locomotor system examination ability and not just the PRHOs undertaking an inappropriate assessment designed to test basic clinical skills of medical students. Consistent with this, the PRHOs felt significantly less confident examining the locomotor system than the other systems. Although the generalisability of these findings is potentially limited by the small sample of PRHOs, we believe the PRHOs in this study to be at worst representative and probably better than the majority of their peers. This is because inclusion in the study was voluntary, the PRHOs had the confidence to allow their clinical skills to be assessed, and all these PRHOs were working in highly sought after posts in teaching hospitals. We do not know whether these PRHOs felt as unconfident examining the locomotor system as undergraduates or whether they had become deskilled from not performing locomotor examinations on patients seen in hospitals.

Traditional medical clinical examinations (long and short cases and orals) have been hampered by their unreliability. The OSCE has good psychometric properties and has better reliability than, for example, oral examinations for a given testing time duration.11 In particular, the student is given a standardised task to do on each station and the marking schedule is similarly standardised, with a view to reducing inter- and intra-observer error. Because the number of clinical tasks undertaken in an OSCE is much larger than traditional British clinical examinations, we could compare the performance of candidates in seven different physical examination stations.

This study was designed to evaluate the effect of incorporating GALS screen teaching into the curriculum. It was not a randomised study of the effect of teaching the GALS screen to a cohort of students in a controlled trial environment. Although such studies have their merits they tend to result in improved student performance because the students are aware that they are being studied12(“Hawthorn effect”) and they do not evaluate the effect of teaching on learning in the uncontrolled real world—that is, the student educational environment. The drawback to standardisation in this examination was that the students performed the GALS screen better if they undertook the OSCE on day 2. This advantage for the day 2 candidates might have been due to them revising the GALS screen overnight. The rigid checklist nature of the GALS screen does make this easy to do. Despite this, the day 1 candidates still performed the examination well with a mean score of 15 (75%), suggesting the GALS screen has been learnt well by these 3rd year medical students. The fact that the GALS screen scores, but not most of the other station scores, improved on the second day of testing reinforces the ease with which it can be learnt, which is one of its desirable properties.

Using PRHOs as a control group is not ideal to assess the impact of GALS screen teaching to undergraduates. What it does tell us is that medical students recently taught the GALS screen examine the joints better than these PRHOs and that, currently, PRHOs examine the locomotor system poorly. Ideally, to assess the impact of GALS screen teaching directly, half of the medical students should have been taught it and the other half taught by traditional rheumatology teaching methods. Currently, in view of the perceived benefit of the GALS screen, it is taught to all our medical students. An alternative would be to compare student performance in an OSCE from two medical schools, only one of which teaches the GALS screen. Such a study would be possible, but it is always difficult to control for other curricular differences between the medical schools.

The students in this study will have been taught the GALS screen up to nine months before the OSCE, depending on when they undertook the GP/rheumatology firms. Although we have shown that medical students can be taught to perform the GALS screen well, the duration of this benefit is uncertain. One small study has shown that one 15 minute GALS screen teaching session increases the likelihood of the locomotor system being examined by junior doctors on hospital inpatients six weeks later.8 Further study is required to see if these medical students retain their confidence and ability to perform a locomotor screening examination when they become PRHOs and beyond, and to see if this confidence is associated with improved diagnostic acumen of rheumatological conditions.

Acknowledgments

We thank the pre-registration house officers who agreed to participate in this study.

References

View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.