The Computer scientists from the Max Planck Institute for Informatics together with colleagues from the US semiconductor manufacturer Intel and the Intel Visual Computing Institute at Saarland University, have developed a method that can reconstruct a digital objects even from incomplete images.
Engineers develop a programmable 3D camouflaging skin
“Although the 3D scanning technology has made significant progress in recent years. It is still a challenge to capture the geometry and shape of a real object digitally and automatically,” explains Mario Fritz, who leads the group “Scalable Learning and Perception” at the Max Planck Institute for Informatics. According to Fritz, depth sensors, such as those of the Microsoft Kinect, are very powerful. But unfortunately they do not work equally well on all materials. It leads to noisy data or even missing measurements.
3D geometries
“The resulting flawed or even incomplete 3D geometries then pose a real problem for a range of applications. For example in virtual or augmented reality, working together with robots, or 3D printing,” explains Mario Fritz.
Together with other researchers from the US semiconductor manufacturer Intel as well as the Intel Visual Computing Institute at Saarland University, he therefore developed a method that also works with incomplete datasets. It uses a special neural network. “Our method requires no supervision during the learning phase, which is novel for this type,” explains Fritz.
In this way, the researchers could, reconstruct a flat monitor. Digital representation after a 3D scan looked rather like a paneled wall. So that everyone could once again recognize a monitor in the digital object. The Saarbrücken computer scientists have thereby surpassed previous methods that improve faulty 3D scans and complete digital shapes. The method from Saarbrücken gives very good results for the classification of scanned objects as well.
In the future, the scientists intend to further develop their method. So that it will also work on deformable objects and larger scenes.
“In the future, it will have to be possible to capture real-world objects simply and quickly. And project them in a realistic way into the digital world,” explains Philipp Slusallek, professor of computer graphics at Saarland University and scientific director of the German Research Center for Artificial Intelligence (DFKI).
Smartwatches to detect hand movement with ultrasound imaging
At the DFKI he is also responsible for the European joint research project “Distributed 3D Object Design,” or DISTRO for short. With which the European Union wants to bring its research disciplines of visual computing. And 3D computer graphics to the forefront worldwide. For this purpose, a new generation of excellent scientists and technicians is to be trained.
