Article Text

PDF
AB1134 Reumeval: Online System for Teacher Evaluation of Rotation in Rheumatology Mir. Results of the Pilot
  1. M. Ά. Belmonte-Serrano1,
  2. P. Tejόn-Menéndez1,
  3. A. Lozano-Saez1,
  4. J.A. Castellano-Cuesta2,
  5. N. Fernández-Llanio-Comella3,
  6. J. Calvo-Catalá2,
  7. A. Ybañez-García4,
  8. R. Belenguer-Prieto5,
  9. F.J. Navarro-Blasco6,
  10. V. Vila-Fayos7,
  11. J.R. Gόmez-Salazarb8,
  12. E. Pascual-Gόmez9,
  13. M. Ventura-Pérez10
  1. 1Rheumatology Service, Hospital General de Castellόn, Castellόn de la Plana
  2. 2Rheumatology Service, Hospital General Universitario de Valencia
  3. 3Rheumatology Service, Hospital Arnau de Vilanova
  4. 4Rheumatology Service, Hospital Universitario Doctor Peset
  5. 5Rheumatology Service, Hospital 9 de Octubre, Valencia
  6. 6Rheumatology Service, Hospital General Universitario de Elche, Elche
  7. 7Rheumatology Service, Hospital de Vinaroz, Vinaroz
  8. 8Rheumatology Service, Hospital de la Marina Baixa de Villajoyosa, Villajoyosa
  9. 9Rheumatology Service, Hospital General Universitario de Alicante, Alicante
  10. 10Family and Community Medicine, Hospital General de Castellόn, Castellόn de la Plana, Spain

Abstract

Objectives Analyze the results of a pilot study to measure the functionality of a new online evaluation system of knowledge in Rheumatology MIR rotating units for this specialty.

Methods It has been developed an online computer test platform for knowledge in Rheumatology with measurable results. 10 centers in the Valencian Community were asked to prepare questions of moderate and attainable complexity to MIR residents from other specialties. The evaluation procedure is carried out in two stages: a first test of 30 questions starts the rotation, which includes demographic data. At the end of the Rheumatology rotation, the MIR perform the second test similarly and lastly, they answer a satisfaction questionnaire about the rotation performed. Each question has 4 options, the valid answer is 1 point and an incorrect answer subtracts 0.25 points.

Results It has been developed a set of 300 multiple choice questions, of which >10% include images. These questions cover topics from the entire spectrum of the specialty. To confirm the suitability of the questions at the expected level of MIR rotating one Delphi round was held between the participants, 59 were detected not suitable questions that were replaced by more affordable.

The results obtained so far correspond to the last 10 months. In assessing 42 physicians participated in MIR formation of which 32 were women (76%). 2 in the province of Castellόn, 6 Valencia and 5 of Alicante results of 13 centers of Valencian Community were obtained. Most respondents were residents of 2nd year (64%) and from the Family and Community Medicine specialty (69%). Of a total of 30 questions in the questionnaire, in the first test (start of rotation) the mean of the correct questions was 18.90±3.81, with a mean failure of 10.50±3.37 and a mean of unanswered questions of 0.60±1.64. In the second test (final rotation), the mean of the correct questions was 21.30±3.59, with a mean failure of 8.43±3.62 and a mean of unanswered questions of 0.26±0.75. An average increase between the two assessments 4.38±2.67 relative to the total score was observed. This corresponds to an average increase of 0.89±1.46 standardized points (range 0-10) after performing the rotation in Rheumatology. The completion time was 22.2±8.57 minutes in the first test and 25.67±11.82 in the second. The satisfaction rates after rotation were >90% in all cases. Acceptance of the system was excellent by tutors and residents.

Conclusions REUMEVAL is an online system that allows an objective assessment of the increase in knowledge of Rheumatology MIR performing rotary units of this specialty. In this pilot study we test the system acceptance by the MIR and their tutors, as well as a demonstrable increase in knowledge after rotation.

Acknowledgements Acknowledgements: Study conducted with the support of the Valencian Society of Rheumatology and partial sponsorship of MSD

Disclosure of Interest None declared

DOI 10.1136/annrheumdis-2014-eular.2037

Statistics from Altmetric.com

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.