3D cameras in autonomous vehicles and robots must always have a very precise view of their surroundings and be able to reliably detect objects in their environment. Essen-based sensor expert ifm is collaborating with Ravensburg-Weingarten University (RWU) on the 3DROBUST research project to give mobile and autonomous robots even better “vision.”

An autonomous robot is only as good as its sensors. They are the machine's senses and thus the central interface to its environment. Correct functioning and high-quality data acquisition are of great importance here, because unlike humans, robots cannot rely on intuition or feelings. 3D cameras are particularly important for mobile and autonomous robots, as they capture the environment and thus communicate where the robot can move. During operation, a robot's movement changes constantly, so data must be captured and analyzed very quickly. The 3DROBUST research project by ifm and RWU aims to develop a reliable stereo camera based on two 3D sensors. The sensors capture distance data using different principles, and high reliability is achieved through an AI-supported combination of the two camera images.

During the three-year project period, an autonomous robot will be used to reduce the number of false alarms in obstacle and object detection. As a scientific partner, RWU is responsible for project management, system design, and algorithm development, with the Physical Engineering, Electrical Engineering, and Computer Science departments involved. As an industrial partner, ifm is responsible for developing and providing the hardware used. The project partners benefit from their proximity to each other. ifm operates one of its main locations in Tettnang on Lake Constance, just under 20 kilometers from the university. The Federal Ministry of Education and Research is funding the project through its “FH-Kooperativ” funding guideline with a sum of around 326,000 euros. The consortium recently presented the project at the international IPTA conference in Paris.

Applications in logistics conceivable

The powerful 3D cameras are particularly suitable for outdoor use. Once the project is complete, the system is to be used in autonomous work machines and logistics applications. The two partners involved hope that their cooperation will yield new insights that will make working with mobile robots more reliable and help them gain greater clarity.