You use gestures, voice or even gaze to interact with the HoloLens. That means you don’t have to use a physical component like a computer mouse or a keyboard to interact with HoloLens applications. This implicates that your hands remain free and sanitized during the entire procedure. Let’s elaborate on how this works.
A first way to interact with the HoloLens is by using hand gestures. The HoloLens tracks every movement of both your hands in real time, and registers these as certain gestures thanks to AI and computer vision. You can compare this with gestures, like ‘swiping’ on your smartphone. It’s a very natural and intuitive way of interacting. Watch the video to see some hand gestures in action.
Just like gestures, your voice can be used to interact with the HoloLens. The device recognizes certain words as commands, while ‘ignoring’ background noise. Microsoft implemented a serie of standard voice commands, that work ‘out-of-the-box’, but custom voice commands can also be created.
Thanks to eye tracking, HoloLens knows at all times where the surgeon, doctor, nurse,… is looking at. This facilitates two features:
As you can see, there are plenty of ways to interact with the HoloLens. Doctors, surgeons or other users are able to use the device without risk of contamination.
Do you have a question about this?
Or maybe want to set up a meeting?
Just give Niels a call or send him an email.