Early Days - Virtual Reality (VR) Technology
Our philosophy and mission has always been to deliver the highest quality medical training and education using the very best techniques, methodology and technology. From our origins at Real Response, delivering simulation-based medical and first aid training in 2017 we began exploring and tinkering with Virtual Reality (VR) Technologies launching our first Virtual Reality (VR) app on GEAR VR followed by our successful Mass Casualty Training Virtual Reality package 'Real MCI'. Released on the HTC Vive tethered VR headset followed by the advancement for use on the revolutionary 6DOF standalone Quest 1 in 2019.
Real MCI, along with several other Virtual Reality (VR) medical and combat medical training applications we built over the years, including our impressive VTC3, which was released in 2022 on the VIVE Focus 3 in support of the Australian Army combat medical training. With the release of VTC3, the most cutting-edge Virtual Reality (VR) tactical combat care experience we had ever built with funding from the Department of Defence, we realised from feedback and in close collaboration with end-users that no matter the funding, no matter the quality of the Virtual Reality (VR) experience or technology, Virtual Reality (VR) or Augmented Reality (AR) technologies was simply not the most appropriate medium for medical training.
Importance of fine motor skills in virtual medical training technologies
Medical training requires fine motor skills, and medics must have the feeling of inserting that intravenous (IV) cannula, feeling the airway, cracking the drug ampule, and having the real apprehension of cutting their finger, ensuring they snap the top of the ampule back correctly.
Controllers in virtual reality (VR) technologies are not appropriate for delivering these outcomes, nor are any haptic systems currently on the market. No force-back feedback glove can simulate the feeling of attaching a reflux valve to an Intraosseous (IO) cannula and pushing the saline flush into the bone. The feedback our team have received
Virtual Reality (VR) Technologies are fantastic for supporting procedural-based training. E.g.) training on the procedure and checklist of surgery, trauma checklist, etc., but they are not appropriate for practising fundamental skills using actual equipment.
Evolution to Mixed Reality (MR) Technologies
At the same time as we came to this conclusion, we identified a novel technology still in its infancy pioneered by Prof Bob Stone and the Royal Centre of Defence Medicine in the UK, 'Mixed Reality (MR)'. Prof Stones's works utilised early VR headsets, web cameras and chroma key to generate a Mixed Reality (MR) environment where military medics could still use their own hands to perform real skills with real equipment.
The evolution of our Mixed Reality (MR) project the 'BlueRoom Simulator' came from a close collaboration with the Royal Australian Air Force under a Department of Defence Innovation Hub contract awarded in 2021 and delivered in late 2022.
This contract focused on delivering a Mixed Reality (MR) technology concept demonstrator to support the problem of accessing aircraft for aeromedical training, specifically the C-130J. Historically, access to this aircraft was extremely difficult due to pilot availability, weather, maintenance issues, cost, and environmental impact.
Once the Mixed Reality (MR) military medical training prototype was delivered, the Royal Australian Air Force procured this Mixed Reality (MR) technology to support aeromedical evacuation training onboard the Lockheed Martin C-130J. The first operational unit was delivered in July 2023 and now allows the Royal Australian Air Force (RAAF) aeromedical teams to train any time of the day or night, under night vision, onboard this aircraft from the safety and convenience of their home base. The BlueRoom Mixed Reality (MR) simulator allows the Air Force to perform an entire medical mission using the real tools on manikins, actors or cadavers as they would in the real world while within the virtual simulator.
Once in service, the RAAF identified that they could expand the use-case of Mixed Reality (MR) technology to support tactical combat casualty care, another module that is hard to access live training. Again, Virtual Reality (VR) or augmented reality (AR) technology does not allow the haptic sensation or using a real tourniquet, using real IVs or other medical gear. A Mixed Reality option was critical.
This updated BlueRoom Mixed Reality (MR) simulator including both aeromedical and tactical combat casualty care modules now affords operators the ability to train from point of injury where they must perform combat care under fire, to a CASEVAC in a Bushmaster/Blackhawk, treatment in a Role 1 medical facility, MEDEVAC onboard a C-130/C17 and treatment in a Role 2/3 facility. All within a single simulator, in a single location that can be adjusted to work in any conditions including under NVGs.
Mixed Reality in use for the Air Force
Our system is now allowing RAAF Health OCU students to practice anytime onboard aircraft they previously were almost never able to access, and access to combat zones to practice tactical medicine under fire. The system is solving a major problem, decreasing the time to competency as they no-longer need to wait for an aircraft to be available, or a major exercise/live fire scenario. Fundamentally, BlueRoom is a force multiplier, allowing for a rapid training capability of our aeromedical teams now and in preparation for a major influx in training requirements. Secondary benefits include, reducing of students travel, reducing cost and environmental impact, reducing on reliance on airframes and meeting the demand of the younger generation of learners who expect interactive educational modalities.
TRL 9 Mixed Reality (MR) Technology
BlueRoom is a TRL 9 technology that has been funded through the Defence Innovation Hub (concluding Nov 2022) to a TRL 6, a significant investment by the owners of BlueRoom Simulations and through two separate RAAF contracts. Additional systems are at market in Melbourne, Dubai in the UAE, Tampa in the US, Hilversum in the Netherlands and Helsinki, Finland.
We then took this idea of using a Mixed Reality (MR) headset in a chroma blue environment and mixed it with a mission control dashboard that allows the instructor to have the creativity needed to manipulate the scenario in real time, tracking student performance, tracking patient trends, all recorded for a hot/cold debrief after.
Furthermore, we ensured that the simulator allowed native interoperability and interchangeability, meaning any nations equipment can drop into BlueRoom for use. Just drop a UK med pack, a NZ ventilator, US oxygen bottle and it will simply work. In addition, it supports training accross nations. Now the US can train onboard an Australian Bushmaster Ambulance, and The Australians can train onboard a V22, or more importantly, US Marines on rotation in Darwin can travel to RAAF Amberley to conduct their medical refresher training on the V22 on a system owned and operated by Australia.
Garmin Biometric x Mixed Reality (MR) Integration & Awards
BlueRoom Mixed Reality (MR) medical simulator combines a biometric tracking system that takes live data from Garmin watches the student is wearing, leverages a stress score derived from heart rate variability and pushes it into the mission control app. Allowing the instructor to interpret and adjust the scenario based on the stress of the learner and sure they stay in a mid zone of stress where they can retain the maximum amount of knowledge and operate at peak performance.
BlueRoom Mixed Reality Simulator Global Reach
Our BlueRoom Mixed Reality (MR) simulator innovation means that our global partners and customers are no longer limited by waiting on access to an aircraft before signing someone off for a course, they no-longer need to wait for access to a range or a live fire scenario to tick someone off for a Combat Casualty Care course. It provides freedom and flexibility to the customer to rapidly train, re-train aviators on demand, at minimal cost, with minimal environmental impact.
Before BlueRoom Simulator (and still now), there was/is no other system in the market that allows learners to immerse themselves in a virtual environment being able to use their own hands and use real objects practicing fine and gross motor skills.
Impact of Mixed Reality Over Virtual Reality
Prior to BlueRoom Simulator, Virtual Reality (VR) was the main technology being pushed for training. We invested a lot of money in Virtual Reality (VR) and realised it just did not work for medical training. You cannot click a controller and expect that is good enough to practice inserting an IV, you need to practice the dexterity of the intervention. This was our experience and the experience of ADF end users.
Now BlueRoom Mixed Reality (MR) users have the ability to run our simulator 24/7, fulfilling their main mission to train medics, doctors, nurses and soliders to operate onboard aircraft and in combat zones.
We look forward to the continued growth and success of the BlueRoom Simulator and the advancement of Mixed and Virtual Reality (VR) technology to support medical and military training with the objective to saves lives
BlueRoom Community Work
We support something called The Lab, The Lab is a network of not for profit technology clubs for young people (aged 8-18) who identify as being on the autism spectrum and who enjoy working with computers. It offers mentoring by technology professionals in areas such as programming, 3D, digital design and social gaming.
Secondly, we run an internship for software graduates with autism, and have had several come through the team for a period for 6 weeks - 3 months.;
In addition we support a STEM program for youth
supported by Defence for kids wanting to start work in the Defence Industry - https://www.blueroomxr.com/post/stem-to-the-rescue
Lastly, we do our best to include qualified staff from different demographics such as sex, religion, culture, colour and economic backgrounds. When assessing our team, although small (8 ppl) we are satisfied that it represents as broad a cross section of society as we can.
Good innovation should follow a human centric approach, for all humans! It my mind it is critical to have a diverse team representing all the end-users no matter where they will be.
Kommentare