On Smart Cities: 5G NR/C-V2X for localization->broadcasting location-> situational awareness->safety and autonomous movement.
Barak Rosenberg
I am an accomplished AI specialist, founder, entrepreneur, manager, programmer, architect. With a rich background in the hi tech industries, management, architecture, programming, AI/ML (including LLM edge/cloud).
Automotive visual sensors have finished their era, AI which uses neural networks recognizes only what it was trained for without "intuition", cameras works badly in dark light/rain/direct sun, Lidar works badly in rain, and uses AI. The only sensor that works in any weather and doesn't use AI is radar that will be used for collision detection.
A new way of thinking was needed to gain the Situational Awareness around the vehicle that works in any weather and recognizes objects around the vehicle even if there is no Line Of Sight to the object. Welcome to the Smart City era.
In Smart Cities we talk about using localization which is calculated using longitude/latitude on earth, but instead of calculating it using GPS/GNSS that uses satellites and it's accuracy depends on weather , we use 5G NR which uses ground antennas(DGPS), does not depend on weather, and can reach accuracy of ~10Centimeters(2-3 Inches), adding to it the broadcasting capabilities of the 5G C-V2X modem, which broadcasts the position of the host vehicle which already has its own localization to the environment in 1.6Km radius(1 mile) we get what we see in the simulation in the above bellow, which can be defined as next "Google maps"/"Waze"/"HERE We Go" routing application with HD-map lane coordinates and multi object on same HD-map for Situational Awareness around vehicle.
The simulation in the film runs real code that uses real HD-map lane coordinates in Berlin/Germany, with several vehicles, each vehicle calculates its own localization using the 5G modem and broadcasts it to all vehicles around using the C-V2X modem capabilities, all code will be run within the modem which also downloads the HD-map tiles into the modem, the modem can easily be the next "ECU" or the computing engine that is in charge of safety and moves the vehicle.
To conclude the 3 steps into automotive smart cities:
- Localization based on 5G NR ground antennas(works in all weather, depends on density of the 5G antenna deployment).
- Situational Awareness around vehicle, that downloads the HD-map tiles according to vehicle place and receives location from vehicles around to create the understanding around vehicle that can't be achieved today using visual sensors.
- Applications: Safety applications like collision detection using path planning of vehicles on top of the HD-map, autonomous movement, platooning.
Only after we have localization and created the Situational Awareness around vehicle, then we reach the safety level needed for collision detection, and only then we can talk about autonomous movement and platooning.
SpearEye develops the software that integrates all of the above.