How Intelligent Image Sensing Leads the Road from ADAS to Autonomous Vehicles

By Radhika Arora, Sr. Director Automotive Solutions

Human error is the main cause of road accidents.

Modern vehicles are equipped with image sensing cameras to see their surroundings and help drivers make extremely time-sensitive decisions to avoid accidents in challenging road/weather conditions. Safety features such as lane keeping, traffic light recognition and pre-collision braking?are available as built-in features in recent models.

Cameras are one of the key sensors required for autonomous driving, along with Lidar, radar, and ultrasonic sensors. One to two megapixels CMOS image sensors are commonly used in today’s ADAS systems. These sensors have evolved from ‘viewing only’ sensors to 'viewing plus sensing.' The advancement in image sensing technology is not only helping the driver to see better, but is literally the eyes of autonomous vehicles (AV). The data collected by sensors relays a vital feed into the decision-making process of the car.

AVs are one of the most highly anticipated innovations with a potential impact on changing the lives of millions globally.

Why does high resolution matter to autonomous driving? Because perception is key. Higher resolution allows smaller objects to be detected and identified by the system. This allows objects and other hazards to be detected at a greater distance, allowing the vehicle to alert the driver and take action sooner, thereby enhancing road safety. This is being driven by the need for autonomous cars to see further and at the same time have the ability to detect objects of all sizes. Essentially, this gives the ability to increase the number of pixels per degree on the object making the job of self-driving algorithms more efficient with both object detection and classification. To give a perspective,?the 8.3 MP AR0820AT sensor ?can perceive 100 times better than human vision.

High dynamic range (HDR) is a key and critical parameter of camera sensors. This is the ability of the sensor to see between the darkest part and brightest part of the scene in the same frame without over or under saturation. In other words, the sensor needs to be impervious to changing ambient light conditions, such as suddenly been exposed to a bright sunny angle or reflection, or driving in/out of a tunnel in daylight.?The AR0820ATprovides the highest dynamic range for up to 185 meters for safe dependable use on AV applications.

...inbuilt cybersecurity ensures reliable and secure operation when multiple cameras around the vehicle are connected to a centralized system

For level 3 AVs and beyond, there is a heavy dependence on hardware and software to make decisions that would otherwise be taken by humans, which can also make vehicles more susceptible to cyber-attacks or hacking. This has prompted work on the development of numerous protection and security features including cybersecurity being added at the sensor level. The inbuilt cybersecurity ensures reliable and secure operation when multiple cameras around the vehicle are connected to a centralized system, in which data and commands must travel by wires between the sensor and the processor. This is an increasingly important issue as vehicles become connected to other vehicles and the environment around them.

As this technology becomes accessible to the general public, it will surely change the way we drive and use transportation.

With a scalable family of image sensors from onsemi, automotive OEMs are able to deploy the optimum sensor for each application within each vehicle they produce while leveraging software and algorithm development across all devices. This reduces both development time and diminishes design risk.

AVs are one of the most highly anticipated innovations with a potential impact on changing the lives of millions globally. The?AR0820AT image sensors ?enable AVs to see further and at the same time have the ability to detect objects of challenging sizes. As this technology becomes accessible to the general public, it will surely change the way we drive and use transportation. But most significantly, we can keep drivers, passengers and vehicles safe on the road.

Bonus: Watch our on-demand webinar to learn about the underlying technology and far-reaching impact of the AR0820AT sensor. Free when you register for the MyON community.

About the Author

Radhika Arora, Sr. Director, Product Management, Automotive Solutions onsemi

Radhika Arora is a proven leader in business development and strategy with an impressive track record of increasing profits and expanding market share. She has had tremendous success in establishing a lasting presence in varied market segments, identifying growth opportunities in new emerging applications, and initiating strong business alliances. She is equally skilled at directing cross-functional teams to manage the complete product life cycle. Radhika currently serves as Sr. Director, Product Management, Automotive Solutions.