Tobii, HTEC and D3 Embedded have announced the development of an interior sensing solution powered by Texas Instruments’ automotive-grade System-on-Chip (SoC) and its high-resolution radar sensor. The solution is the first to fuse single-camera and radar technologies on Texas Instruments’ platform for full interior sensing.
At the core is Texas Instruments’ TDA4VEN processor, part of the Jacinto 7 family. Designed for demanding automotive AI workloads, the processor integrates dedicated AI accelerators capable of up to 4 TOPS, enabling advanced deep learning models for real-time driver and occupant monitoring. Its heterogeneous architecture, combining ARM CPUs, vision accelerators and DSPs, enables ultra-low latency, high efficiency and reliable performance under stringent conditions.
The solution’s visual sensing layer is powered by the STMicroelectronics VG5761 image sensor. Complementing this is the Texas Instruments AWRL6844 mmWave radar sensor, operating in the 60GHz band, which provides enhanced robustness by detecting occupant presence, subtle body movements and vital signs.
By fusing a single-camera solution with a single radar, Tobii’s automotive interior sensing branch, Tobii Autosense, aims to enhance its interior sensing capabilities by covering unique corner cases focused on safety, such as intruder alert, child left behind, or general detections obstructed by in-cabin elements. The mmWave radar is compatible with a single-camera solution, covering all the limitations generated by the wide-field-of-view RGB/NIR sensor. This collaboration leverages Tobii’s interior sensing technology, D3 Embedded’s vision technology and HTEC’s end-to-end system integration with the Jacinto 7 processors and mmWave radar.
“This achievement reflects true collaboration across complementary domains of expertise,” said Henrik Mawby, head of ecosystem and partnerships Tobii Autosense. “Together with HTEC and D3 Embedded, we’ve been able to fuse camera and radar in a way the industry hasn’t seen before, delivering safer and more cost-efficient interior sensing to help auto makers meet tomorrow’s safety standards.”
In related news, Sony unveils IMX775 RGB-IR image sensor with industry’s smallest 2.1µm pixel for advanced in-cabin vehicle monitoring
