Haptic feedback sleeve and goggles allow blind people to 'see' with their arm

Haptic feedback sleeve and goggles allow blind people to "see" with their arm
The results of the mapping algorithm for a hallway. Credit: https://arxiv.org/pdf/2201.04453.pdf

Two researchers with the Center for Digital Technology and Management, Technical University of Munich, have developed a haptic feedback sleeve and goggle system that allows blind people to partially "see" with the skin on their arm. Manuel Zahn and Armaghan Ahmad Khan published a paper describing their sleeve and goggle system on the arXiv preprint server.

As the researchers note, despite advances in technology aimed at assisting the blind, the best tool for helping to navigate in public is still the cane. In this new effort, the researchers built a system that they believe can help and people with other to navigate more easily in public places.

The system consists of a pair of goggles fitted with dual infrared cameras. The cameras create a 3D stereoscopic image of the environment in front of the goggles. The imagery is sent to a tiny computer that translates the to haptic data, which is sent to a haptic sleeve. Inside the sleeve is a 5 x 5 array of small pads pressed against the forearm when the sleeve is worn. The pads vibrate as a means of communicating visual data. Images that are closer vibrate more strongly than those that are farther away. For example, as a person wearing the system walks into a tunnel, the pads at the periphery of the array will start vibrating, alerting the user to the presence of the walls. If the tunnel is narrow, the pads will vibrate more strongly than if it is wide. Similarly, the pads that represent the outline of a person will vibrate more strongly as that person approaches and then cease as they pass by.

Haptic feedback sleeve and goggles allow blind people to "see" with their arm
The inside of the prototype. Credit: https://arxiv.org/pdf/2201.04453.pdf

The researchers point out that their system does not involve use of either the hands or the ears; thus, users can continue to use both to assist in navigating. They note also that because the system uses infrared cameras, it can be used in complete darkness. During testing, they found that users were able to use the system right away and grew more proficient with practice.

More information: Manuel Zahn, Armaghan Ahmad Khan, Obstacle avoidance for blind people using a 3D camera and a haptic feedback sleeve. arXiv:2201.04453v1 [cs.HC], arxiv.org/abs/2201.04453

© 2022 Science X Network

Citation: Haptic feedback sleeve and goggles allow blind people to 'see' with their arm (2022, January 24) retrieved 3 March 2024 from https://techxplore.com/news/2022-01-haptic-feedback-sleeve-goggles-people.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Flexible skin patch provides haptic feedback from a human operator to a remotely operated robot


Feedback to editors