Use of an Observer Tool to Improve Learning Outcomes for Cardiac Arrest Management

Outcomes of cardiac arrest remain poor (1). The International Liaison Committee on Resuscitation (ILCOR) emphasizes that one essential component for good resuscitation outcomes is effective education of the lay public and resuscitation providers (2). Even when modern learning methods (i.e. for example digital aids) are used, the final result at the end of initial training can be described as providing incomplete knowledge and performance. During training sessions, it is often seen that the time during which the learners really act is short and they are positioned in a role of observer for a variable duration (but often a long proportion of the course duration). As it has been shown that observers learn less than those on the "hot seat" (3) and as time for training is limited and the number of trainees is huge, focusing on observers is important to increase the overall level of knowledge.

To increase the positive effects of the simulation when the learner is in the role of observer, some authors have proposed to strengthen the educational effect through the use of an observer tool that observers must complete by analyzing the progress of the task performed by their colleagues (4). This is a list describing the set of key points to be achieved. However, data concerning the educational value of these observer tools are limited. Studies on the use of these tools during crisis management training in the operating room assessed by high-fidelity simulation have been already conducted (5) but good data on the use of such an observer tool in other training fields is needed to confirm these preliminary positive results.

The objective of this study will be to assess the value of using an observer tool (OT) (including mainly the key points of technical performance) to improve learning outcomes of medical students during cardiac arrest training involving simulation. For medical students, learning how to manage a cardiac arrest is taught early in their curriculum, at a stage where their medical knowledge is low, and their overall competence is close to a layperson. This means that improving medical students' learning outcomes may also be a reasonable mean to improve training methods of non-medical personnel.

This prospective and randomized study will be performed in the Paris-Saclay University (LabForSIMS) simulation center.

The study will be carried out with the use of the CONSORT tool adapted for simulation studies and the GREET Tool for educational studies (6).

Students will be in the first part of the 2nd year of their curriculum, explaining why only basic life support is taught at this stage. The training session lasts the whole day and 20-30 students are trained each day. Sessions are mainly focused on cardiac arrest management but a third of the day is dedicated to learning other resuscitation techniques (management of limb hemorrhage, Heimlich maneuver, recovery position for an unconscious patient who maintains spontaneous breathing…).

The cardiac arrest part of the workshop is divided into five portions (diagnosis of unconsciousness, call for help/emergency services, diagnosis of apnea, external cardiac massage and use of an automated defibrillator). At each stage, two students are encouraged to make a spontaneous preliminary performance followed by other students' and teacher's comments and explanations. Students are then invited to perform by themselves the scenario, with progressive increments at each of the five additional portions. In practical terms, students working in dyads, perform initially the procedure which leads to diagnosis of unconsciousness but at the end of the session, they perform the whole five steps described above. When students are not players, they observe the dyad and are encouraged to analyze what has been well done and what could have better performed.

Cardiac massage training is facilitated by the use of a feed-back device (Q-CPR Laerdal ® mannequin equipped with the wireless Skill reporter®software) which displays on a screen the main parameters (i.e. frequency, depth of massage, hand position, rib relaxation), allowing trainees to assess and improve immediately their performance.

In the present study, after informed consent, students will be randomized in to groups:

• Group with an observation tool (OT +) filled out at each time the students are not on the hot seat. The observer tool is paper-based and is divided in columns (each column filled out for a dyad observed) with lines representing the above-described steps of learning and presented with visual incremental actions to be performed. The observer tool will only be used to reinforce learning and will not be used for summative evaluation. Instructors have already been involved in previous simulation studies performed in our center, and especially those in which an observer tool has been assessed (one study published, two manuscripts in preparation).
• Group without observation tool (OT-): these students will be trained as usual, i.e. will be encouraged to express their thoughts after each dyad has finished but will not be given the observer tool.

The randomization will be performed by day as it is not possible to randomize students themselves on a given day for practical reasons.

At the end of the training day, all learners will be again invited to perform a complete cardiac arrest management (basic life support part), using the previously described mannequin with feed-back information. During this ultimate performance, students will not be allowed to see the screen and will not know if they perform adequately. The overall score automatically provided by the Q-CPR/Skill Reporter® system will only be available to the assessor and the result provided to the student at the end of the test with a short feed-back from the instructor.

A 10 question MCQ test will also be applied at the end of the session. This MCQ will be prepared by the instructors who had prepared the checklist to highlight important theoretical knowledge on cardiac arrest management.