You use gestures, voice or even gaze to interact with the HoloLens. That means you don’t have to use a physical component like a computer mouse or a keyboard to interact with HoloLens applications. This implicates that your hands remain free to do your job. Let’s elaborate on how this works.
A first way to interact with the HoloLens is by using hand gestures. The HoloLens tracks every movement of both your hands in real time, and registers these as certain gestures thanks to AI and computer vision. You can compare this with gestures, like ‘swiping’ on your smartphone. It’s a very natural and intuitive way of interacting.
Just like gestures, your voice can be used to interact with the HoloLens. You can compare this with using Siri, Alexa or Google Assistant. Microsoft trained the HoloLens’ voice recognition by making it ‘listen’ to podcasts for over 80 hours in an anechoic chamber. As a result, the device recognizes certain words as commands, even in industrial, harsh conditions with background noise from jackhammers or grinding wheels for instance. A series of standard voice commands work ‘out-of-the-box’, but custom voice commands can also be created.
Thanks to eye tracking, HoloLens knows at all times where you are looking at. This facilitates two features:
Do you have a question about this?
Or maybe want to set up a meeting?
Just give Niels a call or send him an email.