Customized Embedded Vision: The heart of multi-camera and multi-sensor data processing
Data processing units with multiple connected cameras and sensors rely on powerful electronics. Real-time data processing and ultra-low latency requirements, sensor fusion for 360° all-round view and superimposed on-screen graphics and information make the development of such electronics time-consuming and expensive. However, this does not have to be the case: With this article we’d like to present our modular hema electronic GmbH embedded vision platform and show you based on a real-world example, how it shortens development times, reduces costs and minimizes design risks, while at the same time enabling upgrades and product variants.
Based on our hema embedded vision platform, we recently developed a video distribution unit for a German OEM providers’ Driver Vision System for special vehicles. The development from order placement to the first prototype took just 24 month, significantly shortening the time to volume production of the overall solution. The Driver Vision System integrates numerous cameras and sensors and can be used as a standalone Vision System or as an upgrade to existing DVS. There are fore different standard versions of the OEM’s system available, all based on the same electronics, with different computing units for scalable performance and features. Thanks to the rugged design of the electronics and overall system, it withstands shock and vibration as well as harsh environmental conditions. The system even passed certifications according to MIL standards.
Design library for freely configurable hardware
The development of the electronics is based on the hema embedded vision platform, that has been especially designed for embedded vision electronics and applications such as autonomous robots, special vehicles and other stationary or mobile image processing applications. The design is based on over 45 building blocks for interfaces and functionalities, from which the hardware can be freely configured. Developers therefore select the required interfaces from the hema design library. Standard interfaces such as Ethernet, USB, CAN and Wifi / Bluetooth are available, as are common video interfaces. The board format can also be freely selected so that the electronics can be adapted to existing housings. On request, we can also supply complete solutions including customer-specific housings.
In hardware design, there are corresponding templates for the circuit diagram and layout for each of the building blocks for the electronics. The advantage for the customer: They receive their individual electronics within a very short time and at manageable development costs. In contrast to a completely new development, the electronics are based on tried and tested circuits. Customer-specific circuits or functions not yet available in the hema design library can be easily integrated. Longevity and long-term availability is ensured for all components of the system, with proactive lifecycle management from an dedicated inhouse team.
FPGA-based Modules for scalable performance
The computing power of the electronics is provided by System on Modules (SoM) with powerful ARM processors and FPGAs by AMD . All EMC-critical components around the processor are already integrated on the modules, which simplifies the development of the mainboard and in turn contributes to lower costs and shorter development times. The modules are available with different performance classes, processors and memory expansions. A standardized interface ensures compatibility and enables product variants, without the costly redevelopment of the entire electronics and thus perfect for mid-lifecycle upgrades.
The FPGAs on the modules manage the video data: they process the data of the multiple inputs and distribute it to the outputs. All functions are implemented with extremely low latency times of 30ms – 40ms, depending on additional image processing tasks. The processors and FPGAs can also be used to combine video streams into dual and quad view or picture-in-picture data, or to play out graphic overlays via the video outputs. If required, the electronics can also supply finished video data, e.g. for 360° views, which can be stitched together and rectified, or for fusion of day- and night-vision camera data. For this image processing, the electronics include comprehensive software libraries and sample applications that customers can use as a basis for their own application development.
领英推荐
Modular software design and extensive tools
The software for the FPGA electronics is programmed in parallel to the development of the hardware and is also based on modular building blocks, which are customized and individually adapted to the hardware. hema electronic provides code blocks for certain image processing functionalities such as split screen, picture-in-picture, scaling, mirroring, rotating and graphic overlays. This speeds up development and reduces the risk of programming errors. Code blocks for the latest AI chips such as the 英伟达 Jetson series, the Hailo Edge AI processors and the SimAI deep learning tools from Ansys are also integrated into the software library.
Fast implementation of versatile optronic systems
The modular software development process is fully integrated into the digital production workflow of our hema electronics platform. As a result, customers receive within weeks customized solutions that allow to develop, implement and test their own end applications quickly and easily. Thanks to tried-and-tested, industrial-grade circuits and components, your prototypes based on our platform are already very close to the subsequent series hardware. Series optimization, certifications and the start of production can take place in just a few weeks. The hema embedded vision platform is thus the ideal basis for the fast and cost-efficient development of video processing units and other electronics for sensor data processing in numerous military and defense applications, as well as civil use-cases for surveillance and other embedded vision tasks.
Would you like to learn more about the advantages of modular hardware and software design for your project? I’m happy to discuss all this with you. Please send me a direct message and I’ll get in contact as soon as possible!
?