New tool uses AI to flag fake news for media fact-checkers

New tool uses AI to flag fake news for media fact-checkers
Credit: University of Waterloo

A new artificial intelligence (AI) tool could help social media networks and news organizations weed out false stories.

The , developed by researchers at the University of Waterloo, uses deep-learning AI algorithms to determine if claims made in posts or stories are supported by other posts and stories on the same subject.

"If they are, great, it's probably a real ," said Alexander Wong, a professor of systems design engineering at Waterloo. "But if most of the other material isn't supportive, it's a strong indication you're dealing with fake ."

Researchers were motivated to develop the tool by the proliferation of online posts and that are fabricated to deceive or mislead readers, typically for political or economic gain.

Their system advances ongoing efforts to develop fully automated technology capable of detecting by achieving 90 per cent accuracy in a key area of research known as stance detection.

Given a claim in one post or story and other posts and stories on the same subject that have been collected for comparison, the system can correctly determine if they support it or not nine out of 10 times.

That is a new benchmark for accuracy by researchers using a large dataset created for a 2017 scientific competition called the Fake News Challenge.

While scientists around the world continue to work towards a fully automated system, the Waterloo technology could be used as a screening tool by human fact-checkers at social media and .

"It augments their capabilities and flags information that doesn't look quite right for verification," said Wong, a founding member of the Waterloo Artificial Intelligence Institute. "It isn't designed to replace people, but to help them fact-check faster and more reliably."

AI algorithms at the heart of the system were shown tens of thousands of claims paired with stories that either supported or didn't support them. Over time, the system learned to determine support or non-support itself when shown new claim-story pairs.

"We need to empower journalists to uncover truth and keep us informed," said Chris Dulhanty, a graduate student who led the project. "This represents one effort in a larger body of work to mitigate the spread of disinformation."

A paper on their work, "Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection," was presented this month at the Conference on Neural Information Processing Systems in Vancouver.


Explore further

Public believe more than half of fake news about healthcare spread online, major study reveals

More information: Chris Dulhanty et al. Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection. arXiv:1911.11951 [cs.CL]. arxiv.org/abs/1911.11951
Citation: New tool uses AI to flag fake news for media fact-checkers (2019, December 16) retrieved 1 June 2020 from https://techxplore.com/news/2019-12-tool-ai-flag-fake-news.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
289 shares

Feedback to editors

User comments