STMicroelectronics and Leopard Imaging® have introduced an all-in-one multimodal vision module designed for humanoid and other advanced robotics systems.
It brings together ST’s imaging, 3D scene mapping, and motion-sensing technologies with NVIDIA Holoscan Sensor Bridge, and connects natively to NVIDIA Jetson and the NVIDIA Isaac open robot development platform.
This helps engineers build sophisticated vision systems while staying within the tight size, weight, and power budgets of humanoid robots.
Powered by NVIDIA Holoscan Sensor Bridge, the module connects to NVIDIA Jetson over Ethernet for real-time sensor data ingestion and integrates directly with the NVIDIA Isaac platform, which provides open AI models, simulation tools, and developer libraries.
The solution comes with a build system and APIs, AI algorithms tuned for mobile robots, sample applications, domain-randomization capabilities, and a simulation environment complete with sensor models.
The module delivers multimodal perception by combining 2D imaging, 3D depth sensing, and human-like motion perception in a single package.
NVIDIA Holoscan Sensor Bridge enables multi-gigabit, plug-and-play connectivity with Jetson platforms, while NVIDIA Isaac support ensures a smooth path from concept to deployment for robotics developers.
As a key partner for NVIDIA in robotics and edge AI, ST is continuing to integrate its sensors, drivers, actuators, controllers, and development tools into the NVIDIA robotics ecosystem, including high-fidelity models and proof-of-concept modules.
Leadership Comments
“Humanoid robotics is moving beyond research projects and demonstrations to deliver powerful new machines for a wide range of roles in manufacturing and automotive factories, logistics and warehousing, as well as retail and customer service,” said Marco Angelici, Vice-President of Marketing and Application for Analog Power MEMS and Sensors, at STMicroelectronics. “Our collaboration with Leopard Imaging brings market-
leading ST sensors and actuators, seamlessly integrated into the NVIDIA robotics ecosystem, to accelerate the deployment of physical AI applications with human-like awareness.”
“Accessing to ST sensors and actuators directly within the ecosystem has allowed us to standardize and streamline data acquisition and logging for humanoid robot vision across the HSB interface,” said Bill Pu, CEO of Leopard Imaging. “Robot builders can use our multi-sensing vision module with Isaac tools to accelerate learning and quickly bridge the ‘sim-to-real’ gap.”
To Know More: CLICK HERE
