We hope to design a new approach to clinical education delivered through the use of AR with high fidelity manikins can be used to train team based scenarios, such as Code Blue trainings, where multiple roles are involved. AR is able to overlay information and graphics onto the manikin, enabling trainees to obtain a visual and tactile sense of an emergency situation or training scenario. AR complements high fidelity manikins, allowing more clinical symptoms such as inflammation and changing of skin tone to be superimposed on to the manikin. With the use of AR more complex scenarios could be created as it allows us to change the clinical symptoms or situation during a simulation run, testing for nursing adaptability.AR also brings a new dimension of realism by allowing manikins to portray emotions such as sadness or pain, and psychological symptoms such as confusion and dazed.
AR with gesture recognition feature adds an additional level of interactivity. We would be able to evaluate participants for proper execution of technical skills or actions, such as correct hand placement during cardiac compression, trainees can also receive instant prompts on their incorrect actions. AR aural and speech user interface (UI) would allow basic interaction with the manikin to develop trainee’s soft skills in managing patients.