Ambarella, Inc. has launched an artificial intelligence (AI) vision processor capable of recording 8K video or four 4K video streams. The ‘CV5’ system on chip (SoC) will enable the development of intelligent automotive camera systems, consumer cameras (drone, action, and 360°), and robotic cameras.
CV5 combines Ambarella’s powerful CVflow AI engine with dual Arm® A76 CPUs to provide the performance necessary for a wide range of AI-based algorithms. Its advanced image signal processor (ISP) can simultaneously process images for both human viewing and machine processing. Fabricated in advanced 5 nm process technology, CV5 consumes under 2 watts of power while encoding full 8K video at 30 frames per second.
“With the introduction of CV5, Ambarella is defining the next generation of automotive, consumer, and robotic cameras,” said Fermi Wang, CEO of Ambarella. “By combining 8K single-channel and 4K multi-channel recording with the high performance of our CVflow AI engine, we are enabling cameras with the highest-quality imaging and innovative new AI features.”
In automotive video telematics applications, CV5 provides the performance necessary to encode multiple video streams from front ADAS, driver monitoring, cabin monitoring, and side-view cameras. Its CVflow AI engine can simultaneously run advanced driver assistance systems (ADAS) algorithms such as lane departure, and forward collision warning as well as driver monitoring algorithms such as drowsy driver detection. The combination of high-resolution video capture with advanced AI processing enables ADAS cameras to recognize images over long distances and with high accuracy.
The exceptionally low power consumption of the CV5 SoC also makes it an ideal solution for the next generation of high resolution and high frame-rate action, 360°, and virtual reality (VR) cameras, offering 8K recording and playback in very small form factor designs.
In robotic and drone applications, CV5’s CVflow AI engine can accelerate simultaneous localization and mapping (SLAM), path planning, and obstacle detection, and avoidance algorithms for navigation and autonomous operation. For drone-based aerial videography and cinematography, CV5 can simultaneously perform flight control and navigation functions while recording up to 8K resolution video recording at 60 frames per second.
The CV5 SoC shares common SDK and computer vision (CV) tools with Ambarella’s other CVflow SoC families, simplifying development of cameras with multiple price and performance options. A complete set of CV tools helps customers port their own neural networks onto CV5, including a compiler, debugger, and support for industry-standard machine learning frameworks, such as PyTorch™, ONNX™, Caffe™, and TensorFlow™, as well as extensive guidelines for convolutional neural network (CNN) performance optimization.
