Speech recognition faster at texting

August 25, 2016 by Bjorn Carey

Credit: Peter Griffin/Public Domain

Smartphone speech recognition software gets a bad rap. Most users find the nascent technology to be frustratingly slow, and there are entire blogs dedicated to documenting examples of its biggest – and sometimes hilarious – mistakes.

But results from a new experiment suggest a different reality: Speech recognition can be used to compose text messages faster and more accurately than humans can type on mobile phone screens.

"Speech recognition is something that's been promised to us for decades, but it has never worked very well," said James Landay, a professor of computer science at Stanford and co-author of the new study. "But we were noticing that in the past two to three years, was actually improving a lot, benefiting from big data and deep learning to train its neural networks to produce faster, more accurate results. So we decided to formally test it against humans."

The research team, which included computer scientists from Stanford, Baidu Inc. and the University of Washington, devised an experiment that pitted Baidu's Deep Speech 2 cloud-based speech against 32 texters, ages 19 to 32, working the built-in keyboard on an Apple iPhone.

"They grew up texting, so we're putting speech recognition up against people who are really good at this task," Landay said.

The video will load shortly.

The subjects took turns typing or speaking about 100 phrases sourced from a standard library of everyday phrases used in text-based research – phrases such as "physics and chemistry are hard," "have a good weekend" and "go out for some pizza and beer" – while the testing app recorded their times and accuracy rates. Half the subjects performed the task in English using the QWERTY keyboard; the other half conducted the test in their native Mandarin using iOS' Pinyin keyboard.

The results were clear no matter the language. For English, speech recognition was three times faster than typing, and the was 20.4 percent lower. In Mandarin Chinese, speech was 2.8 times faster, with an error rate 63.4 percent lower than typing.

"We knew speech recognition is pretty good, so we expected it to be faster, but we were actually quite surprised to find that it was almost three times faster than typing on a keyboard," said co-author Sherry Ruan, a computer science PhD student at Stanford who helped run the experiments.

Although the researchers used Baidu's , they suspect that other high-accuracy speech engines perform at a similar level. Now that the team members have quantified that speech recognition actually works well, they hope it will encourage engineers to design user interfaces that take better advantage of the technology.

"We should put speech in more applications than just typing an email or text message," Landay said. "You could imagine an interface where you use speech to start and then it switches to a graphical interface that you can touch and control with your finger."

Explore further: Self-learning computer software can detect and diagnose errors in pronunciation

More information: Speech Is 3x Faster than Typing for English and Mandarin Text Entry on Mobile Devices. hci.stanford.edu/research/speech/paper/speech_paper.pdf

Provided by Stanford University

7 shares
add to favorites email to friend print save as pdf