Data mining hyphenated headlines: Improving named entity recognition

news
Credit: CC0 Public Domain

Data mining and extraction of knowledge from disparate sources is big data, big business. But, how does the search software cope with entities that are mentioned where only part of their name is used or a name is hyphenated when it normally isn't? Research published in the International Journal of Intelligent Information and Database Systems reveals details of a new approach to improving named entity recognition and disambiguation in news headlines.

Jayendra Barua and Rajdeep Niyogi of the Department of Computer Science and Engineering, at the Indian Institute of Technology, in Roorkee, Uttarakhand, India, explain that their approach to such an analysis of current headlines builds on a trained algorithm that has been taught to remove the hyphens and complete incomplete names to remove ambiguity.

The team's evaluation of their novel approach shows that it works with approximately 10 percent greater accuracy than conventional systems and so could improve the automated retrieval of news associated with particular companies, organizations, events, public figures, and other entities of interest to those data mining the news. The system works well with newsfeeds, such as the RSS type of newsfeed generated by regularly updated websites. Headlines from such sources might commonly be longer than conventional newspaper headlines but are nevertheless succinct, commonly being ten or fewer words long. Each word might then be important in a context and so disambiguation is critical.

More information: Jayendra Barua et al. Improving named entity recognition and disambiguation in news headlines, International Journal of Intelligent Information and Database Systems (2020). DOI: 10.1504/IJIIDS.2019.104530

Provided by Inderscience
Citation: Data mining hyphenated headlines: Improving named entity recognition (2020, January 22) retrieved 28 March 2024 from https://techxplore.com/news/2020-01-hyphenated-headlines-entity-recognition.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Rating news sources can help limit the spread of misinformation

2 shares

Feedback to editors