Bad weather data could help autonomous vehicles see

road salt
Credit: CC0 Public Domain

Sensors that operate in Scotland's rain, snow and fog are providing data that could help autonomous vehicles see and operate safely in adverse weather.

The Radiate project led by Heriot-Watt University has published a new dataset that includes three hours of radar images and 200,000 tagged road actors including other vehicles and pedestrians.

The dataset solves a problem that has been facing manufacturers and researchers of .

Until now, almost all the available, labeled data has been based on sunny, clear days. This meant there was no public data available to help develop autonomous vehicles that can operate safely in conditions.

It has also relied primarily on data collected from optical sensors, which, much like human vision, don't work as well during bad .

Professor Andrew Wallace and Dr. Sen Wang have been collecting the data since 2019, when they kitted out a van with light detection and ranging (LiDAR), radar and stereo cameras, and geopositioning devices.

They drove the car around Edinburgh and the Scottish Highlands to capture urban and at all times of day and night, purposefully chasing bad weather.

Professor Wallace said: "Datasets are essential for developing and benchmarking perception systems for autonomous vehicles.

"We're many years from being on the streets, but autonomous vehicles are already being used in controlled circumstances or piloting areas.

"We've shown that radar can help autonomous vehicles to navigate, map and interpret their environment in bad weather, when vision and LiDAR can fail. "

The team says by labeling all the objects their system spotted on the roads they've provided another step forward for researchers and manufacturers.

Dr. Sen Wang says that they "labeled over 200,000 road objects in our dataset—bicycles, cars, pedestrians, traffic signs and other actors. "

"We could use this data to help autonomous vehicles predict the future and navigate safely."

"When a car pulls out in front of you, you try to predict what it will do—will it swerve, will it take off? That's what autonomous vehicles will have to do, and now we have a database that can put them on that path, even in bad weather."

The team is based at Heriot-Watt's Institute of Sensors, Signals and Systems, which has already developed classical and deep learning approaches to interpreting sensory data.

They say their ultimate goal is to improve perception capability.

Wallace says that they "need to improve the resolution of the radar, which is naturally fuzzy. If we can combine hi-res optical images with the weather-penetrating capability of enhanced that takes us closer to autonomous vehicles being able to see and map better, and ultimately navigate more safely."

More information: RADIATE dataset website:

Citation: Bad weather data could help autonomous vehicles see (2021, August 9) retrieved 3 October 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Autonomous vehicles learning to drive by mimicking others


Feedback to editors