Alif Semiconductor, onsemi build an AI camera reference design using AI/ML - The EE

Alif Semiconductor, onsemi build an AI camera reference design using AI/ML

Pleasanton, United States – Alif Semiconductor and onsemi, a provider in intelligent power and sensing technologies, collaborated to create a complete camera reference design to maximise performance and efficiency for low power applications using machine vision such as supplemental security cameras, biometric ID passage control, retail management, and smart eyewear.

The challenge of implementing imaging products with a long battery life and enough localised AI/ML capability to be useful comes down to power consumption, ML inference latency time, and many times fitting into a restrained physical space. These issues are addressed by combining technologies from Alif using a highly integrated low-power MCU, and a compact low-power image sensor from onsemi.

Alif’s Ensemble family of secure microcontrollers (MCUs) contain an ample amount of on-chip memory to store and process all image data without the need for external components that add cost, size, and consume extra energy. To further reduce power consumption, Alif’s proprietary aiPM technology utilises dual-processing regions within the MCU that accelerate machine learning. The MCU’s high efficiency region is designed to be always on to sense the environment, while the MCU’s high performance region wakes as needed to rapidly execute heavy workloads and return to sleep. For example, the high-performance region can complete an ML inference for object detection in just 786 μsec, which is 87 times faster than a typical competing Arm Cortex-M based MCU running the same task at similar clock frequency. The dual processing regions in ensemble MCUs enable extremely long battery life by serving up the optimum amount of processing power at any given time to satisfy immediate requirements.

“We’ve incorporated onsemi’s sensor onto our development kit making it quite simple for developers to build their own AI imaging products,” says Mark Rootz, VP of marketing at Alif Semiconductor. “Starting from scratch on a design like this is no easy task when you deal with managing an image pipeline while optimising machine learning and stretching power efficiency to the max. We do it all here in this reference design.”

onsemi provides image sensors with a wide choice of resolutions, optical formats, and technologies for IoT applications including drones and barcode scanners. The ultra-miniature ARX3A0 sensor in this reference design is extremely low power, drawing less than 3.2 mW while active.

“onsemi offers a portfolio of low-power sensors designed specifically for AI/ML applications, which matches perfectly with the power-efficient engine in Alif’s MCUs,” says Steve Harris, senior director of marketing at onsemi. “This combination of low-power sensing and processing results in maximised battery or power efficiency for a broad range of AI-based systems.”

For more information, come to the onsemi booth (101) in hall C4 at electronica 15 Nov 2022, and visit our website at Alif Semiconductor.

Follow us and Comment on Twitter @TheEE_io

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.