Researchers call for harnessing, regulation of AI

human ai
Credit: CC0 Public Domain

Artificial intelligence appears to be "widening inequality," and its deployment should be subject to tough regulations and limits, especially for sensitive technologies such as facial recognition, a research report said Thursday.

The AI Now Institute, a New York University center studying the social implications of , said that as these technologies become widely deployed, the are starting to emerge.

The 93-page report examined concerns being raised "from AI-enabled management of workers, to algorithmic determinations of benefits and , to surveillance and tracking of immigrants and underrepresented communities," the researchers wrote.

"What becomes clear is that across diverse domains and contexts, AI is widening inequality, placing information and control in the hands of those who already have power and further disempowering those who don't."

The researchers said AI systems are being deployed in areas such as healthcare, education, employment, "without appropriate safeguards or accountability structures in place."

The report said governments and businesses should halt use of facial recognition "in sensitive social and political contexts" until the risks are better understood, and that one subset—"affect recognition" or the reading of emotions by computer technology—should be banned in light of doubts about whether it works.

Emotion "should not be allowed to play a role in important decisions about human lives, such as who is interviewed or hired for a job, the price of insurance, patient pain assessments, or student performance in school," the report said.

It also called for tech workers "to have the right to know what they are building and to contest unethical or harmful uses of their work."

The AI Now report said medical organizations using advanced technologies need to implement data protection policies and allow people "affirmative approval" opportunities to withdraw from the study or treatment, and from research using their medical information.

More broadly, the researchers said the AI industry needs to make "structural changes" to ensure that algorithms are not reinforcing racism, prejudice or lack of diversity.

"The AI industry is strikingly homogeneous, due in large part to its treatment of women, people of color, gender minorities, and other underrepresented groups," the report said.

Efforts to regulate AI systems are underway, but "are being outpaced by government adoption of AI systems to surveil and control," according to the report.

"Despite growing public concern and regulatory action, the rollout of and other risky AI technologies has barely slowed down," the researchers wrote.

"So-called 'smart city' projects around the world are consolidating power over civic life in the hands of for-profit technology companies, putting them in charge of managing critical resources and information."

© 2019 AFP

Citation: Researchers call for harnessing, regulation of AI (2019, December 12) retrieved 15 April 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

IBM: face recognition tech should be regulated, not banned


Feedback to editors