Hitachi Astemo, Ltd. has developed a prototype 360-degree stereo vision system for automated vehicles travelling on regular streets. Based on multi-camera 3D sensing, the all-surrounding sensing system is both high-resolution and highly accurate.
Automated driving systems
Most of the current automated driving systems are limited to highway driving. To enable automated driving systems to be used on public roads, they need to accurately recognise the entire road environment around the vehicle, including a complex mix of objects such as pedestrians and bicycles.
Radar and LiDAR systems with high-ranking accuracy, however, still face cost issues before they can see widespread adoption, and all-surrounding-area camera systems, which although superior in terms of cost, are mainly based on a monocular cameras are still continually evolving to improve accuracy and other issues.
A 360-degree stereo vision system prototype
With multi-camera 3D sensing into a single in-vehicle camera system, the system realises a 360-degree stereo vision
Hitachi Astemo, together with the Research and Development Division of Hitachi, Ltd., leveraged its strengths in stereo camera technology to develop a 360-degree stereo vision system prototype, using multi-camera 3D sensing that enables distance measurement with stereo camera technology.
Instead of the conventional module consisting of two cameras with the same view angle and being nearly parallel to each other, the camera layout has been made more flexible to use a combination of approximately 10 cameras with different angles of view, including non-parallel cameras to provide stereoscopic 3D vision. By integrating multi-camera 3D sensing into a single in-vehicle camera system, the system realises 360-degree stereo vision, with a cost advantage, high accuracy, and resolution.
Accurate distance information
By generating highly accurate distance information in stereo and all around the vehicle, the system can detect such elements as the distance of a vehicle traveling in the adjacent lane, or a two-wheeled vehicle slipping through a line of cars from behind in a traffic jam.
It can estimate the relative speed and direction of movement and apply this information for vehicle control to avoid collisions and entanglement at intersections.
Recognition, reliability, and environmental resistance
In addition to basic object recognition of objects such as cars, motorcycles, pedestrians, and traffic lanes, the recognition function also includes turn signals, red lights, and brake lights to predict the behaviour of other vehicles; as well as traffic signals, road signs, road edges, and free space areas available for driving all of which are necessary to identify for while driving on ordinary roads.
Furthermore, Hitachi Astemo has improved reliability and environmental resistance in camera sensing such as features to resist water droplets and dirt adhering to the lens surface or shielding the entire lens in the snow. The AI has learned malfunction patterns caused by these factors and can identify malfunction factors in each camera, thereby preventing malfunctions.
Cost advantages
Hitachi Astemo combines cost advantages to expand the scope of automated driving systems
Going forward, Hitachi Astemo will continue to strengthen its 360-degree stereo vision systems that combine cost advantages with high accuracy and resolution, as well as improved reliability and environmental resistance, to expand the scope of automated driving systems for use on general roads.
Hitachi Astemo is committed to strengthening its business and delivering technological innovation through a strategic business portfolio, which consists of the Powertrain & Safety Systems business, Chassis business, Motorcycle business, Software business, and Aftermarket business.
Advanced mobility solutions
Aiming for a better environment globally and growth around the pillars of “green,” “digital,” and “innovation,” Hitachi Astemo will deliver highly efficient internal combustion engine systems; electric systems that reduce emissions; autonomous driving for improved safety and comfort; advanced driver assistance systems; and advanced chassis systems.
Through such advanced mobility solutions, Hitachi Astemo will contribute to realising a sustainable society and provide enhanced corporate value for the customers.