Ambarella, Lumentum and ON Semiconductor Collaborate on AI Processing Based 3D Sensing for Next-gen AIoT Devices
Originally intended for biometric access control and electronic locks, these new reference designs can also address the needs of smart cities, smart buildings, smart homes and intelligent healthcare. Additionally, the high level of integration provided by these joint solutions significantly lowers system power consumption and thermal design requirements while enabling much smaller product form factors.
“Ambarella’s vision is to combine AI processing with 3D and vision sensing to create an ambient intelligent future,” said Fermi Wang, President and CEO of Ambarella. “This collaboration with
“Our new joint solutions will greatly increase the accuracy of AIoT devices across application verticals—starting with biometric access control and electronic locks—enabling them to recognize people and predict their needs, rather than requiring a direct human interface,” said
“Image sensors are the eyes for intelligent sensing devices. Their ability to see farther with more detail provides significantly more information for the AI processor’s decision-making in AIoT devices,” said
The three companies’ new joint AIoT solutions consist of two reference designs and additional 3D sensing development kits, each uniquely configured to address application-specific demands for the combination of AI processing, 3D depth sensing and vision sensing:
- Targeted at next-generation biometric access control readers, the Vision+ reference design is the AIoT industry’s first 4K solution to perform single-camera, 940nm structured-light sensing based on RGB-IR technology. It is also the first to leverage a single-chip solution for depth processing, AI processing and video processing. Based on the Ambarella CV22 CVflow® AI vision processor, it includes single-camera structured-light sensing powered by Lumentum’s VCSEL technology, featuring a range of 2 meters, and a 4K (8MP) RGB-IR CMOS image sensor from ON Semiconductor.
- Targeted at next-generation smart electronic door locks, or eLocks, for both commercial and residential applications, the Saturn reference design is the AIoT industry’s first to integrate AI processing for both single-camera structured-light sensing and fast-boot video processing. It is based on the Ambarella CV25 CVflow AI vision processor and includes a structured-light camera powered by Lumentum’s VCSEL technology and the AR0237CS 2MP RGB-IR image sensor from ON Semiconductor.
- Targeted at intelligent sensing applications and with opportunities across verticals, Ambarella’s CV2 series CVflow AI vision processor-based development kits can now be outfitted with ToF sensor adapters that are powered by Lumentum’s leading-edge VCSEL arrays. An optional 4K RGB-IR image sensor adapter is also available for these kits.
The open software development kit (SDK) for Ambarella’s CVflow AI vision processors allows the easy integration of third-party applications while enabling OEMs to address differing regional requirements with a single platform (for example, using different AI algorithms in different regions). Additionally, this robust, Linux-based SDK expands the capabilities of edge sensing devices, simplifies product development and speeds time-to-market through:
- Custom application development capabilities
- Support for different 3D modalities, including structured light and ToF. Uniquely, a single Ambarella SoC provides 3D sensing processing without the need for a dedicated depth processor or a separate host processor
- High AI inference capabilities on the camera device to enable multiple neural networks (NNs) running simultaneously
- Robust AI tools to support deep neural network (DNN) development and migration
- Integrated ISP to handle challenging scenes, including high dynamic range (HDR) and low light scenarios
- Built-in Arm® processors to run customer applications
- Integrated security hardware, including secure boot, OTP to store encryption keys and Arm TrustZone technology for secure encryption key comparisons
- Rich peripheral interface support to simplify system designs
These joint reference designs and development kits are expected to be available in June. For more information, contact Ambarella: https://www.ambarella.com/contact-us/.
Additionally, the three companies will present these new joint solutions on
Ambarella’s products are used in a wide variety of human and computer vision applications, including video security, advanced driver assistance systems (ADAS), electronic mirror, drive recorder, driver/cabin monitoring, autonomous driving and robotics applications. Ambarella’s low-power systems on chip (SoCs) offer high-resolution video compression, advanced image processing and powerful deep neural network processing to enable intelligent cameras to extract valuable data from high-resolution video streams. For more information, please visit www.ambarella.com
About ON Semiconductor
All brand names, product names, or trademarks belong to their respective holders. Ambarella reserves the right to alter product and service offerings, specifications, and pricing at any time without notice. © 2021 Ambarella. All rights reserved.
A graphic accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/1301d53b-3156-4903-8a5c-4f2c7f891e4b
Ambarella Contacts Media contact:
Eric Lawson, Ambarella, email@example.com, (480) 276-9572 Investor contact: Louis Gerhardy, Ambarella, firstname.lastname@example.org, (408) 636-2310 Lumentum Contacts Media contact: Sean Ogarrio, Lumentum, email@example.com, (408) 546-5405 Investor contact: Jim Fanucchi, Darrow Associates, firstname.lastname@example.org, (408) 404-5400 ON Semiconductor Contacts Media contact: Amy Heimpel, ON Semiconductor, email@example.com Investor contact: Parag Agarwal, ON Semiconductor, firstname.lastname@example.org