Teledyne FLIR announced the release of an expanded free thermal dataset for Advanced Driver Assistance Systems (ADAS) and self-driving vehicle researchers and developers.
The expanded starter dataset nearly doubles the original, industry-first free dataset and features more than 26,000 annotated images from the US, England, and France in day and nighttime conditions.
Vehicle safety algorithm performance
It also triples the number of categories and includes person, bike, car, motorcycle, bus, train, truck, traffic light, fire hydrant, street sign, dog, skateboard, stroller scooter, and other vehicle labels.
The expanded free starter thermal imaging dataset allows the automotive and academic community to quickly evaluate the vehicle safety algorithm performance, neural network testing, and thermal sensors, such as the FLIR ADK™.
Free thermal dataset
The expanded dataset, with more images and categories, will further enhance the detection and classification"
“The industry-first free thermal dataset has been used by developers and as a tool in academic research to explore the safety of automated driving technology with thermal imaging,” said Chris Posch, Director of Automotive Engineering at Teledyne FLIR.
Chris Posch adds, “The expanded dataset, with more images and categories, will further enhance detection and classification models, especially focused on automatic braking capabilities as part of a multispectral, sensor-fused system.”
Thermal sensors
When combined with visible light cameras, LIDAR, and radar, thermal sensors help create a comprehensive and redundant system to identify and classify roadway objects using sensor fusion data.
Testing has demonstrated that thermal sensors are uniquely capable of seeing pedestrians, large animals, and other vulnerable road users in conditions where current automatic emergency baking (AEB) systems are challenged, including in total darkness, most fog, smoke, shadows, inclement weather, and sun or headlight glare.
Thermal-enabled AEB on vehicles
In an ongoing effort to make roads safer, twenty automakers committed to the U.S. Congress that all newly manufactured cars and trucks will be equipped with AEB systems by September 1, 2022. Furthermore, high-profile testing and demonstrations from leading organisations including AAA, demonstrate the need for more effective and intelligent systems to improve vehicle safety, especially in challenging conditions where thermal cameras excel.
With the potential for millions of thermal-enabled AEB on vehicles, Teledyne FLIR anticipates the cost of its thermal sensor to continue to decrease significantly, which will encourage wide-scale adoption and ultimately enable safer vehicles and roads.