Amazon smart display 'eyes' aid visually impaired

Amazon's Echo Show devices can use computer vision and machine learning to recognize common objects, helping the visually impair
Amazon's Echo Show devices can use computer vision and machine learning to recognize common objects, helping the visually impaired, who can ask the digital assistant, "Alexa, what am I holding?"

Amazon on Monday added a feature enabling its Echo Show smart screens to recognize household pantry items as part of an effort intended to help the blind and visually impaired.

A new "Show and Tell" capability available for Alexa on Echo Show devices in the US lets users get audible replies to the question "What am I holding?"

Echo Show screens built with camera capabilities use and machine learning technology to recognize what people have in hand, according to the Seattle-based technology titan.

"It's a tremendous help and a huge time saver because the Echo Show just sits on my counter, and I don't have to go and find another tool or person to help me identify something," mechanical engineer Stacie Grijalva said in a blog post.

"I can do it on my own by just asking Alexa."

Grijalva, who lost her sight as an adult, is technology manager at a center for the blind and visually impaired in the California coast city of Santa Cruz that worked with the Amazon team.

"The whole idea for Show and Tell came about from feedback from blind and low vision customers," said Sarah Caplener, head of Amazon's Alexa for Everyone team.

"Whether a customer is sorting through a bag of groceries, or trying to determine what item was left out on the counter, we want to make those moments simpler by helping identify these items and giving customers the information they need in that moment."

Major technology firms including Apple, Google and Microsoft invest in making innovations more accessible or helpful to people with disabilities, which is seen as being good for business as well as socially beneficial.

Being able to interact with smart speakers or other devices by voice can be a boon for the visually impaired, while features such as automatic captioning of online videos can aid those who can't hear.

© 2019 AFP

Citation: Amazon smart display 'eyes' aid visually impaired (2019, September 23) retrieved 9 December 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Amazon digital assistant Alexa gets new skill: amnesia


Feedback to editors