IBM computer proves formidable against two human debaters

IBM pits computer against human debaters
Noa Ovadia, left, and Dan Zafrir, right, prepare for their debate against the IBM Project Debater, Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)

An argumentative computer proved formidable against two human debaters as IBM gave its first public demonstration of new artificial intelligence technology it's been working on for more than five years.

The new skills show that computers are getting better at mastering human language and speech.

The computer made its case for government-subsidized space research by pulling in evidence from its huge internal repository of newspapers, journals and other sources. After delivering opening arguments, the computer listened to a professional human debater's counter-argument and spent four minutes rebutting it.

The company unveiled its Project Debater in San Francisco on Monday. IBM selected possible topics based on whether they were debatable, but neither the computer nor the human debaters knew the topic in advance. Nonetheless, the computer championed the topic fiercely with just a few awkward gaps in reasoning.

"Subsidizing space exploration is like investing in really good tires," argued the computer system, its female voice embodied in a 5-foot-tall machine shaped like a monolith with TV screens on its sides. Such research would enrich the human mind, inspire young people and be a "very sound investment," it said, making it more important even than good roads, schools or health care.

After closing arguments it moved on to a second debate about telemedicine.

An IBM research team based in Israel began working on the project not long after IBM's Watson computer beat two human quizmasters on a "Jeopardy" challenge in 2011.

But rather than just scanning a giant trove of data in search of factoids, IBM's latest project taps into several more complex branches of AI. Search engine algorithms used by Google and Microsoft's Bing use similar technology to digest and summarize written content and compose new paragraphs. Voice assistants such as Amazon's Alexa rely on listening comprehension to answer questions posed by people. Google recently demonstrated an eerily human-like voice assistant that can call hair salons or restaurants to make appointments.

But IBM says it's breaking new ground by creating a system that tackles deeper human practices of rhetoric and analysis, and how they're used to discuss big questions whose answers aren't always clear.

IBM pits computer against human debaters
Dan Zafrir, left, and Noa Ovadia, right, prepare for their debate against the IBM Project Debater Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)

"If you think of the rules of debate, they're far more open-ended than the rules of a board game," said Ranit Aharonov, who manages the debater project.

IBM doesn't try to declare a winner of the debates, but Noa Ovadia, one of the human debaters, said the computer was a formidable opponent even if it made a few too many blanket statements about space exploration being the pinnacle of human achievement.

Ovadia, a national debate champion in Israel, said she was impressed by its fluency in language and ability to construct sentences. She said the computer was able to "get to the bottom line of my arguments" and respond to them.

Among several outside experts IBM invited to attend Project Debater's debut was Chris Reed, who directs the Centre for Argument Technology at the University of Dundee in Scotland. Reed said he was impressed by its grasp of "procatalepsis"—a rhetorical technique that involves anticipating an opponent's argument and preemptively rebutting it.

IBM pits computer against human debaters
Dr. Ranit Aharonov, manager, left, and Dr. Noam Slonim, right, principal investigator, right, pose for a photo in front of the IBM Project Debater before a debate between the computer and two human debaters Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)

As expected, the machine tends to be better than humans at bringing in numbers and other detailed supporting evidence. It's also able to latch onto the most salient and attention-getting elements of an argument, and can even deliver some self-referential jokes about being a computer.

But it lacks tact, researchers said. Sometimes the jokes don't come out right. And on Monday, some of the sources it cited—such as a German official and an Arab sheikh—didn't seem particularly germane.

"Humans tend to be better at using more expressive language, more original language," said Dario Gil, IBM's vice president of AI research. "They bring in their own personal experience as a way to illustrate the point. The machine doesn't live in the real world or have a life that it's able to tap into."

IBM pits computer against human debaters
Noa Ovadia prepares for her debate against the IBM Project Debater Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)

There are no immediate plans to turn Project Debater into a commercial product, but Gil said it could be useful in the future in helping lawyers or other human workers make informed decisions.

  • IBM pits computer against human debaters
    Dr. Noam Slonim, principal investigator, stands with the IBM Project Debater before a debate between the computer and two human debaters Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)
  • IBM pits computer against human debaters
    Dan Zafrir prepares for his debate against the IBM Project Debater Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)
  • IBM pits computer against human debaters
    Dr. Noam Slonim, left, principal investigator and Dr. Ranit Aharonov, right, manager, pose near the IBM Project Debater before a debate between the computer and two human debaters Monday, June 18, 2018, in San Francisco. IBM on Monday will pit a computer against two human debaters in the first public demonstration of artificial intelligence technology it's been working on for more than five years. The system, called Project Debater, is designed to be able to listen to an argument, then respond in a natural-sounding way, after pulling in evidence it collects from Wikipedia, journals, newspapers and other sources to make its point. (AP Photo/Eric Risberg)

© 2018 The Associated Press. All rights reserved.

Citation: IBM computer proves formidable against two human debaters (2018, June 19) retrieved 19 March 2024 from https://techxplore.com/news/2018-06-ibm-pits-human-debaters.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Google's Duplex should come with a caveat, says artificial intelligence expert

182 shares

Feedback to editors