VimedixAR from CAE Healthcare Uses Microsoft Hololens for Futuristic Ultrasound Training

cae healthcare hololens ultrasound simulator ar

During our IMSH 2017 “favorite products” recap I shared about my first look at the Augmented Reality version of CAE Healthcare’s Vimedix Ultrasound simulator. The CAE VimedixVR ultrasound simulator leaps to life with the Microsoft HoloLens module. Freed from the limits of a two-dimensional environment inside a monitor, users can display, enlarge, turn, and rotate realistic-looking anatomical parts, or command them to return into the manikin body. Learners engage in augmented reality to view the inter-relatedness of internal structures, and witness (in real time) the ultrasound beam as it cuts through human anatomy. CAE representatives explained to me that that you can “gather your learners for a shared, immersive experience that will inform and delight as our HoloLens-based solutions will inspire deeper understanding from the start, and awaken their imaginations to better treatments and tools to improve patient care.”

This video is one of a great series you can check out on CAE Healthcare’s Vimeo page!

More from CAE about the Hololens



“We are on the cusp of a new frontier in simulation for healthcare,” said Dr. Robert Amyot, president of CAE Healthcare. “Augmented and virtual reality can accelerate learning and provide shared training experiences in a more immersive and engaging clinical learning environment. Our engineering team is just beginning to explore possibilities with the Microsoft HoloLens, and we look forward to offering it as a key training solutions technology to our industry partners.”

The CAE Healthcare team has already begun to develop training prototypes with the medical device industry that incorporate the Microsoft HoloLens and are expected to accelerate professional  education for new technologies.  With CAE Healthcare’s virtual views of human anatomy and the Microsoft HoloLens, physicians will be able to practice placing cardiac devices or implants with speed and precision before they perform procedures on real patients.

“At Microsoft our goal with HoloLens and mixed reality is to help customers visualize and interact with 3D content in ways that offer new possibilities for creation, collaboration and consumption of information,” said Lorraine Bardeen, General Manager, Microsoft HoloLens and Windows Experiences. “It is inspiring to see how CAE is integrating HoloLens into its healthcare simulation portfolio, and we are excited about the opportunities mixed reality presents to revolutionize the future of patient education and training through the use of holographic computing.”

The “aha” moment for me was being able to see my device insertion past the physical walls of the anatomy. Now I can see exactly what was happening outside AND inside the body at the same time! Genius!

Learn more and sign up for future updates about CAE Healthcare Hololens products here!


Sponsored Advertisement:


Virtual and Augmented Reality Market To Reach $162 billion by 2020

virtual-reality-utilization-engagement

Sim Champs before you know it AR and VR technologies will become a mandatory part of our healthcare educational programs. The opportunities to learn and train in high-cost risk-heavy environments in a safe and affordable manner will continue to expand through advanced learning technologies like augmented and virtual reality. HealthySim will continue to report tidbits of progress in this arena as its applications to healthcare become ever clearer. Today, we share the expectations of the industries growth to demonstrate the upward trend in utilization:

BusinessInsider.com reports that the total revenue for virtual reality (VR) and augmented reality (AR) is projected to increase from $5.2 billion in 2016 to over $162 billion in 2020, according to the IDC:

  • More than half of the revenue will come from VR/AR hardware sales. Additionally, service revenues are projected to increase over the period as demand grows for enterprise-class support. Software was also mentioned as a smaller, but notable revenue source, growing more than 200% year-over-year (YoY) in 2016. Nevertheless, services revenue will quickly surpass it, largely due to demand in the enterprise segment.
  • AR systems will ultimately contribute more revenue than VR systems. Games and paid content will be strong sources of revenue for VR systems, particularly in the next two years. However, this revenue will be eclipsed as AR systems are integrated into healthcare, product design and management-related uses.
  • Most revenue through 2020 will come from the US. The US, Western Europe, and Asia Pacific (excluding Japan) are projected to account for three-quarters of revenue for VR and AR. The US is projected to contribute a larger amount as time progresses.

The adoption of AR and VR headsets will be driven primarily by the introduction of less expensive models to the market, first powered by smartphones before mainstream adoption of stand-alone headsets. While early adopters will drive the initial wave of purchasing, sustainable growth will likely come from VR and AR app developers building a robust and engaging ecosystem of content that entices slower adopters. Lastly, as the underlying technology powering these devices increases, so too will the capabilities, creating new use cases in entertainment, workplaces, and education.

Read the full Market Report on BusinessInsider

Case Western Reserve, Cleveland Clinic Collaborate with Microsoft for Mixed-Reality Technology for Education

microsoft medical simulation

Shared from Case Western Reserve University:

Case Western Reserve University Radiology Professor Mark Griswold recently shared how “HoloLens” can transform learning across countless subjects, including those as complex as the human body. Speaking to an in-person and online audience at Microsoft’s annual Build conference, he highlighted disciplines as disparate as art history and engineering—but started with a holographic heart. In traditional anatomy, after all, students like Ghodasara cut into cadavers to understand the body’s intricacies. With HoloLens, Griswold explained, “you see it truly in 3D. You can take parts in and out. You can turn it around. You can see the blood pumping—the entire system.”

In other words, technology not only can match existing educational methods—it can actually improve upon them. Which, in many ways, is why Cleveland Clinic CEO Toby Cosgrove contacted then-Microsoft executive Craig Mundie in 2013, after the hospital and university first agreed to partner on a new education building. “We launched this collaboration to prepare students for a health care future that is still being imagined,” Cleveland Clinic CEO Delos “Toby” Cosgrove said of what has become a 485,000-square-foot Health Education Campus project. “By combining a state-of-the-art structure, pioneering technology, and cutting-edge teaching techniques, we will provide them the innovative education required to lead in this new era.”

Because the technology is relatively easy to use, students will be able to build, operate and analyze all manner of devices and systems. “[It will] encourage experimentation,” Buchner said, “leading to deeper understanding and improved product design.”

In truth, HoloLens ultimately could have applications for dozens of Case Western Reserve’s academic programs. NASA’s Jet Propulsion Laboratory already has worked with Microsoft to develop software that will allow Earth-based scientists to work on Mars with a specially designed rover vehicle. A similar collaboration could enable students here to take part in archeological digs around the world. Or astronomy students could stand in the midst of colliding galaxies, securing a front-row view of the unfolding chaos. Art history professors could present masterpieces in their original settings—a centuries-old castle, or even the Sistine Chapel.

“The whole campus has the potential to use this,” Griswold said. “Our ability to use this for education is almost limitless.”

Read the full Hololens article here!

 


Supported Organization:


SimX Augmented VR Glasses Win IMSH Serious Games Showcase | Video Interview

augment reality

At the IMSH 2015 HealthySim had a chance to interview Ryan Ribeira, CEO of SimX, and practicing resident physician in emergency medicine at Stanford. Ryan was showcasing SimX at the 5th Annual Serious Games and Virtual Environments Showcase and Arcade which took place at IMSH 2015 in New Orleans, LA and provided over 300 attendees demonstrations of more than 21 entries. The event, started by Dr. Eric B. Bauman, continues to attract exceptional talent from around the world and did a fantastic job of highlighting some serious technology advances in our field such as SimX – which walked away as the WINNER of the Small Business or Corporation category.  (Click here to visit TheClinicalPlayground.com for a full showcase awards recap).

More about SimX:

Virtual Patients: SimX’s software replaces your physical simulation mannequins with a customizable, high-definition, 3D virtual patient, that can be projected onto any empty hospital bed. Whether obese, pregnant, young, old, vomiting, missing limbs, bleeding, or expressing any number of other physical signs and symptoms, SimX’s software allows you to reproduce patient presentations with unprecedented visual fidelity.

Case Builder: Build complex cases in minutes using the powerful visual case building system. Drag & drop events onto the field, determine the environment, and set patient data with just a few clicks. Use SimX’s powerful case monitoring and feedback system to see the case from each trainee’s perspective, and adjust case parameters on the fly.

Global Case Marketplace: SimX allows you to access thousands of cases from top hospitals across the globe! Let your trainees learn from specialists at the cutting edge of their field. Tap into the expertise of your own simulation specialists. Market your cases to the world and turn your expertise into revenue.

Direct Integration: SimX is built so that your trainees can learn using the tools you already have right at your institution. You can use your own beds, monitors, ultrasounds, stethoscopes, even your existing simulation manniquins! It’s easy to ensure that SimX software will recognize your tools, and allow your trainees to use them in the simlation.

Cloud Based Software: SimX’s marketplace, case authoring tools, and moderator interface are all located on the cloud, so you don’t have to worry about downloads or compatibility issues. Write and run cases from your desktop, laptop, or even your mobile device! If it has a browser, it works with SimX.

Reporting:  SimX’s case authoring and moderating tools come with powerful reporting features built right in. Every order, request, and event is recorded on the case timeline, so your team can debrief and see how cases might have gone if their decisions had been different. Create powerful reports that can help you pinpoint where trainees need the most help, and can track the improvement of teams or individuals over time.

Learn more at SimXAR.com!

SimX Offers Augmented Reality Medical Simulations Through META 1 Wearable System

simx-meta1

*Jan. 2015 Update: Watch Our IMSH 2015 Serious Video Games Showcase Interview with SimX who won “best small business company”!*

‘The technology of medical simulation continues to rapidly evolve with a new announcement from Immersive wearable headset manufacturer Meta that their new “Meta 1” Augmented Reality goggles have recently started shipping. CNN says the Meta 1 “makes you a real life Tony Stark”. Below are some breakdowns about the hardware and software being developed specifically for medical simulations with a video demonstration recorded at TechCrunch: Disrupt. Augmented reality overlays 3d animations in real time over your physical envrionment. So in the photo above, SimX CMO Dr. Srihari Namperumal sees a virtual patient lying on the bed because of the QR code that is placed on the gurney surface. This provides learners with an opportunity to see virtual patients existing in real environments!

meta1

Key Features of the Meta 1 Device

  • True Scale Holograms: See the physical and holographic worlds merge through our 3D stereoscopic display in real size, depth and parallax.
  • Markerless Surface Tracking: Look around the room and watch as holographs stay anchored to physical tables, floors and walls – thanks to our low-latency, 360º tracking.
  • Natural User Interface: Grab, pinch and touch 3D objects in the real world, and drive a touch-based holographic user interface.

About SimX Augmented Reality Medical Simulation Software

“SimX’s software replaces your physical simulation mannequins with a customizable, high-definition, 3D virtual patient, that can be projected onto any empty hospital bed.  Whether obese, pregnant, young, old, vomiting, missing limbs, bleeding, or expressing any number of other physical signs and symptoms, SimX’s software allows you to reproduce patient presentations with unprecedented visual fidelity.

Build complex cases in minutes using the powerful visual case building system.  Drag & drop events onto the field, determine the environment, and set patient data with just a few clicks.  Use SimX’s powerful case monitoring and feedback system to see the case from each trainee’s perspective, and adjust case paramaters on the fly. “

Watch the demos above and learn more at the SimX and META websites!

Sheffield Hallam University Uses Augmented Reality to Increase Manikin Fidelity

augmented reality medical simulation

Sheffield Hallam University was recently featured on BBC news for their augmented reality system which increases realism of stagnate simulators by overlaying recorded standardized patient videos on top of the manikin. This is a step in the right direction towards increased fidelity for patient simulator engagements. Because this is such an innovative project, I have copied several links to additional information below:

From the Sheffield Hallam website:

Sheffield Hallam University has become the UK’s first higher education institution to use a new piece of cutting edge technology that assesses empathy and compassion in healthcare.

Augmented reality (AR) has been introduced into the University’s nursing and midwifery curriculum which sees videos of patients, played by actors, superimposed onto training manikins. The computer-generated images or video of the patient is overlaid onto the dummy via an iPad tablet and provides a ‘real’ account of the patient experience.

It is designed to give trainee nurses a range of scenarios to test their reactions and their patient communication skills. Jean Flanagan, assistant dean and head of nursing and midwifery, said ‘The introduction of augmented reality has been a hit with our students and staff and it has allowed us to realistically assess how our students are going to perform when they are out on the wards.’ Read the full article on the SHU website.

nursing simulation augmented reality

Click to watch the awesome BBC coverage of the AR system“Medical mannequins can be a useful training aid but interacting with them can feel unnatural. But at Sheffield Hallam University augmented reality is now being used to ‘turn’ the mannequin into a real person. The app contains various scenarios, recorded by actors, to make the situation feel more realistic. Once the introduction has been made using the app, the mannequin can be remotely controlled to continue reacting in keeping with the simulation.”

You can also download the presentation slides from the session entitled “Human Patient Simulation – Now with Added Reality” from HPSN given by Mel Lindley, Senior Lecturer in Physiotherapy within the Allied Health Professions department; Deborah Clark, Senior Lecturer within the Nursing and Midwifery department; Robin Gissing, Technology Enhanced Learning Advisor for the Faculty of Health & Wellbeing.

Finally, download this report entitled “Using Augmented Reality” from UK’s Council of Deans: “Student feedback indicates that learning was furthered by the interactive workbook being created by students for students as it enabled students to better understand the level of knowledge required for their stage of training. Annual course review and module evaluation have both demonstrated that students value this module above all others due to its level of interaction, realism and preparation for clinical practice.”