Intuitive machine control using speech recognition

The practice of using voice-controlled machines in manufacturing was previously considered prone to errors, and as a result, it was hardly ever adopted. Now, Fraunhofer IDMT has developed a solution that allows machines to be controlled using voice commands. Even on a noisy factory floor, the speech recognition system functions reliably, according to the researchers. Employees speak into a wireless headset or a stationary microphone — and in the future, they could use smart hearable technology, which the institute branch for Hearing, Speech and Audio Technology HSA is also working to develop. Loud ambient noise is almost entirely tuned out using a combination of directional microphones and an effective noise-cancelling system.

“For the first time, our technology is enabling people to control machines in manufacturing using voice commands in a reliable, intuitive way,” said Marvin Norda, the project manager for Voice Controlled Production at Fraunhofer IDMT. “For manufacturing companies, this means increased efficiency and lower costs.”

The technology also has advantages for employees, as contactless machine operation is safe and hygienic for people. When employees are controlling multiple machines, it reduces how far they need to walk — they can use a mobile device to issue voice commands to the equipment from a distance. They have both hands free, allowing them to place a workpiece in position in the work area while giving the robot an instruction such as “lower the arm” or “grip the workpiece” at the same time.

Controlling a machine through voice commands is more efficient than using a control panel or touch panel — clicking through nested menu structures is a cumbersome and error-prone process, whereas direct voice commands involve simple instructions.

“The speech recognition technology can handle hundreds of individual commands depending on the application and is not limited to a particular voice,” Norda added. “New or modified commands can be quickly added and trained into the system.”

The researchers from Oldenburg can draw on many years of experience and expertise in researching and developing audio technologies and speech recognition software.

“We are developing adaptable system solutions for industry customers. The voice control system can be configured to meet their individual needs and quickly put into operation,” Norda said. The speech recognition software can be integrated in the cloud or the company server, depending on the company’s requirements. It is also possible to incorporate a mini PC or even integrate the system into a machine’s PLC without any issues.

The solution is now ready for the market and is already being tested by some industry customers.

Image caption: Machines such as this milling machining centre can be controlled using speech recognition systems and audio technology from Fraunhofer IDMT. Image © Fraunhofer IDMT/Anika Bödecker