Inspection robot can do parkour and walk across rubble

Researchers at Eidgenössische Technische Hochschule Zürich (ETH Zurich) have used machine learning to teach the ANYmal quadruped industrial inspection robot new skills so that the robot can now climb over obstacles and successfully negotiate pitfalls.

ANYmal has for some time had no problem coping with stony terrain, but now it is proving adept at parkour, a sport based on using athletic manoeuvres to smoothly negotiate obstacles in an urban environment. This means that ANYmal can now be proficient at dealing with the tricky terrain commonly found on building sites or in disaster areas.

To teach ANYmal these new skills, two teams, both from the group led by ETH Professor Marco Hutter of the Department of Mechanical and Process Engineering, followed different approaches.

Working in one of the teams is ETH doctoral student Nikita Rudin, who does parkour in his free time. “Before the project started, several of my researcher colleagues thought that legged robots had already reached the limits of their development potential,” he said, “but I had a different opinion. In fact, I was sure that a lot more could be done with the mechanics of legged robots.”

With his own parkour experience in mind, Rudin set out to further push the boundaries of what ANYmal could do. And he succeeded, by using machine learning to teach the quadrupedal robot new skills. ANYmal can now scale obstacles and perform dynamic manoeuvres to jump back down from them.

In the process, ANYmal learned like a child would — through trial and error. Now, when presented with an obstacle, ANYmal uses its camera and artificial neural network to determine what kind of impediment it’s dealing with. It then performs movements that seem likely to succeed based on its previous training.

Is that the full extent of what’s technically possible? Rudin suggests that this is largely the case for each individual new skill. But he adds that this still leaves plenty of potential improvements. These include allowing the robot to move beyond solving predefined problems and instead asking it to negotiate difficult terrain like rubble-strewn disaster areas.

Getting ANYmal ready for precisely that kind of application was the goal of the other project, conducted by Rudin’s colleague and fellow ETH doctoral student Fabian Jenelten. But rather than relying on machine learning alone, Jenelten combined it with a tried-and-tested approach used in control engineering known as model-based control. This provides an easier way of teaching the robot accurate manoeuvres, such as how to recognise and get past gaps and recesses in piles of rubble. In turn, machine learning helps the robot master movement patterns that it can then flexibly apply in unexpected situations. “Combining both approaches lets us get the most out of ANYmal,” Jenelten said.

As a result, the quadrupedal robot is now better at gaining a sure footing on slippery surfaces or unstable boulders. ANYmal is soon also to be deployed on building sites or anywhere that is too dangerous for people — for instance, to inspect a collapsed house in a disaster area.

Top image: ANYmal on a civil defence training ground. Credit: ETH Zurich/Fabian Jenelten.