On localization,V2X and Smart Cities
Barak Rosenberg
I am an accomplished AI specialist, founder, entrepreneur, manager, programmer, architect. With a rich background in the hi tech industries, management, architecture, programming, AI/ML (including LLM edge/cloud).
Sensors have their problems with weather(Cameras do not work in the dark, Lidar does not work in the rain). The use of AI which uses neural networks and does not "learn", receives a defined input to fit its weights to specific data. All the sensors purpose is to understand the environment around vehicle, where they fail. This is the stage where the world is now, regarding automotive safety and autonomous vehicles.
The only sensor that truly works, that does not require AI, is the radar, which will work in any weather.
It seems that the biggest problem, and most important infrastructure for safety, is the localization(location) of the vehicle, when using localization information all other aspects of safety come into hand and are available like HD-maps, and collision detection . Even for creating HD-maps which require accuracy of <10CM, the localization of the vehicle must be fixed to the level of <10CM, since host vehicle that creates the HD-map uses Lidar to create the HD-map and all coordinates of the HD-map depend on the location accuracy of the host vehicle.
The world is moving from GPS/GNSS satellite localization with ~1-1.5meter accuracy that totally depends on weather and clouds, that interfere with the signal that is coming from satellites into using 5G antennas on ground , that are used instead of satellites using triangulation of time of arrival of packets or signal strength to calculate position of the vehicle that work in any weather, and has 2-3CM accuracy(when there is enough coverage of 5G antennas).
Welcome to 5G/C-V2X which is the most fundamental technology to create Situational Awareness, this technology will solve the localization problem-since 5G antennas on ground are used instead of problematic satellites, and location of the vehicle is broadcasted to all vehicles and to infrastructure around, to create full Situational Awareness, this technology with the help of radars, is the only technology that does not depend on weather, and will be used for Smart Cities.
In this simulation that uses real HD-map coordinates in Berlin, Germany and localization: Dynamic HD-map display for Situational Awareness , you can see the Situational Awareness created around vehicle, using HD-map lane coordinates, and another vehicle near the host vehicle, you can call it next Waze/Google maps/HERE WeGO, with lanes(especially important in junctions), and multi objects around vehicle. This is the Dynamic HD-map with lanes and multi objects that will include vehicles and pedestrians.
The steps towards Smart Cities:
- 5G NR/C-V2X technology, that came to the world in 2020. This wireless communication technology is used for both localization(ground antennas), and broadcasting location of host vehicle to all environment, and is the basis for everything related to Smart Cities.
- Creating Situational Awareness dynamic picture around vehicle that includes lane coordinates(mostly important in junctions), for safety purposes like collision detection that uses path planning of vehicles around and also checking movement speed and direction of vehicles around, with radars(for vehicle detection, that don't have V2X modem).
- Applications of Situational Awareness like: Safety(Collision detection using path planning when we have HD-map lane coordinates and localization), autonomous movement inside lane, movement between lanes with broadcasting intentions,platooning of several V2X vehicles together.
We are now talking with several Tier 1's, and several HD-map providers, all of them interested in localization of <10CM that does not depend on weather, and on any sensors, to get to the next step which is Situational Awareness around vehicle.
Welcome the true and only solution for Smart Cities that works in any weather and does not depend on AI: 5G NR/C-V2X localization and wireless communication between vehicles/infrastructure and pedestrians.