The TRUMPF computer vision team is teaching artificial intelligence (AI) to classify data correctly. The experts are willing to do whatever it takes – including categorizing 100,000 images by hand. Five years ago, Professor Sepp Hochreiter, a pioneering figure in the field of AI, called on the machine-building industry not to “drop the ball”. Hochreiter, who works at Linz University in Austria, still wants to see more data and faster progress – but he’s full of enthusiasm about recent events in Ditzingen.
“Sheet metal is an absolute nightmare for cameras!” says Korbinian Weiß. He has spent years trying to make the two things more compatible. “Sheet metal is thin and bendy, it reflects light, it can be wobbly – and it comes in endless shapes and sizes,” he says. Cameras struggle to even recognize a metal surface – but artificial intelligence (AI) is offering new solutions to these problems.
DATA PROVIDES THE KEY
Weiß heads up the AI image-recognition team at TRUMPF in Ditzingen. His preference would be to have at least 24 cameras installed in machines such as the TruLaser Center 7030, TRUMPF’s first fully automated laser system. But right now the system has to make do with 12 cameras, which deliver huge quantities of images and video clips. These and many other types of data provide the key to continuously improving existing machines and developing entirely new products. This data forms the foundations of the computer vision team’s work. But what role does AI actually play in the TruLaser Center 7030 as it slices its way through one sheet after the next? And how do we define AI in this context anyway? AI is a research field with numerous sub-specialties, one of which is machine learning. In order for machines such as the TruLaser Center 7030 to “learn” – in other words, to get better and more efficient at what they do – they need tools and methods in the form of appropriate software. Computer vision is one of those methods.
SORTING GUIDE SOLUTION
Thirty-seven-year-old Weiß trained as a mechanical engineer, but he began developing software-driven initiatives not long after joining TRUMPF. One of the projects he led was the TRUMPF Sorting Guide, which did not originally include AI in its plans. The project team initially thought the Sorting Guide would work on the basis of conventional algorithms. “Everything seemed great in our test facility, the results were fantastic,” says Weiß. But then they took it to the test customer, “and nothing worked”. The problem was the lighting. The algorithms were overwhelmed by the mix of light and dark materials, the reflective surfaces, and all the objects in the visual environment. “Without AI, we wouldn’t have been able to cope,” he says. To train the AI, the computer vision team had to manually classify and label 100,000 images. By telling the system whether a sheet-metal part was visible or not in each image, and using the corresponding algorithms, the team was able to teach the software to continuously improve the accuracy of its predictions in multiple training loops.
AI ISN’T EVERYTHING
“Ninety-five percent of the solution is data, and just five percent AI,” says Weiß, explaining where the team had to focus their attention. “The challenge was collecting the data in the first place, curating and labeling it, compiling datasets to meet different problem-solving goals and getting the right balance within the data.” Sometimes traditional algorithms are all that are needed to solve a customer’s problem – but often it takes more. A lot has happened in the field of computer vision since TRUMPF launched its Sorting Guide in 2020. As well as improvements in the technology and algorithm databases, there has also been a shift in people’s mindset. “Nowadays, we’re thinking about data from the moment we start developing a product,” says Weiß. That’s why the TruLaser Center 7030 contains cameras. And it’s also why TRUMPF now has access to entirely new business models – one of which is Pay per Part.
