The case of hidden entities: e.g., an occluded cyclist. Credit: Örebro Universitet

In traffic, humans are used to constantly anticipating what will happen next. This reasoning ability is something that today's self-driving vehicles and AI systems in general are lacking. In a recent study, together with colleagues in Germany and India, Mehul Bhatt has shown that combining modern neural learning with common-sense reasoning can overcome some of the pitfalls ailing self-driving vehicles today. The study was published in the Artificial Intelligence journal (AIJ).

"The developed AI method results in vehicles learning to understand the world much like humans. With understanding also comes the ability to explain decisions," says Mehul Bhatt.

As a result, self-driving vehicles can recognize that a cyclist hidden behind a car for a few seconds still exists until it reappears. The approach enables self-driving vehicles to demonstrate a wide range of similar -like common-sense capabilities. Such capabilities have not been achievable in self-driving vehicles or other AI technologies that are based on machine learning alone.

"Our method lets a self-driving vehicle understand a course of events, in this case, that visibility is blocked by a car and that after the car has passed, the cyclist will be visible again. This level of understanding is essential for self-driving vehicles to be traffic-ready under different driving conditions and environments."

Inclusion, safety and trust

Security is another significant advantage of developing AI technologies that see and understand the world as humans do. This new AI method enables to show why they have made a particular decision in traffic—such as sudden braking—something that today's autonomous vehicles cannot.

Mehul Bhatt stresses, "It is of utmost importance that we do not have non-transparent technologies driving us around that no one fully understands, neither the developers of the AI, nor the manufacturer or engineers of the vehicles themselves. If self-driving cars are to share the same space as people, we need to understand how these cars are making decisions."

This is also crucial, not the least in studying accidents, resolving insurance issues, and assisting those with special needs.

"At the end of the day, standardization is crucial. We need to achieve a shared understanding of the technologies in self-driving cars—as we do with the technologies in airplanes. At the moment, we're far from it. This will only happen if we fully understand the technologies we're developing," says Mehul Bhatt.

Developing technology for people

In addition to developing AI , Mehul Bhatt and doctoral student Vasiliki Kondyli at Örebro are studying how humans behave in traffic by allowing test subjects to drive cars in virtual worlds under experimentally controlled traffic situations.

"Results from such human behavior studies are utilized to develop human-centered AI technology for that can perform at a level meeting human expectations," explains Mehul Bhatt.

Influencing traffic of the future

The development of autonomous vehicles is in full swing, and according to Mehul Bhatt, now is the time to influence the future of smart mobility systems.

"I want to contribute to the development of autonomous technologies that safely and legally take us from point A to point B while also fulfilling accessibility requirements and societal norms. Since we'd never allow a human to drive a car without a driver's license, I think we should put at least the same demands on autonomous vehicles," concludes Mehul Bhatt.

More information: Jakob Suchan et al, Commonsense visual sensemaking for autonomous driving – On generalised neurosymbolic online abduction integrating vision and semantics, Artificial Intelligence (2021). DOI: 10.1016/j.artint.2021.103522

Provided by Örebro Universitet