IMAB

Goal

As part of the research project "Intelligent Manufacturing Assistant Bot (IMAB) - Middleware for voice assistants for global auditory human-technology interaction in industrial plants", the partners Heilbronn University, Grossenbacher GmbH and SABO Mobile IT GmbH are developing a solution that will serve to create a platform for the integration of assistants into existing machines and is of interest to the entire German mechanical engineering sector.

A universal intermediate layer with a voice user interface (VUI) for natural language dialogs.
Short training time thanks to intuitive operation.
Hands-free machine control in combination with classic user interfaces.
Receiving instructions, informing the operator and checking the information exchanged by asking questions.
Ensuring that a machine functions according to the operator's specifications and taking into account its technical performance.
Retrofit solution - can be integrated into control systems from leading manufacturers in existing systems via OPC UA interface.
Instructions to machines only by authorized persons through AI-supported speaker recognition.
Can also be used in environments with significant noise pollution.

The deep integration of the assistant into the machine software and the understanding of natural language communication is the key to controlling the machine, in contrast to voice control systems available on the market with a limited command set that humans, not the machine, have to learn.

Benefits

The hardware platform enables voice control of machines and integrates advanced audio solutions as well as offline functionality. It can be integrated into the machine control system via OPC UA.

Control machines from a distance, without direct or visual contact with the machine, without the need for cleanliness and lighting. Ideal for users with dirty hands or with sterility requirements.

To ensure that only authorized users can access voice recordings, GDPR-compliant speech recognition is integrated.

A voice chatbot is being developed that recognizes the user's intention and enables communication with the machine control. Machine information is converted into context-related voice commands.

Voice commands speed up the exchange of information by eliminating the need for manual navigation. The universal voice framework ensures precise machine control and increases efficiency and user-friendliness.

Dialogues are not analyzed or recorded, personal data is not stored, context-related data is not enriched and there is no unwanted speaker recognition.

The IMAB project aims to create an integration platform for incorporating voice assistants into existing machinery, making it highly relevant to the entire German mechanical engineering sector.

In loud industrial environments, noise makes it difficult to recognize voice commands. Intelligent noise cancellation, which adapts to ambient noise and minimizes typical background noise, ensures clear voice input here.

Partners

SABO Mobile IT GmbH (consortium leader)

SABO Mobile IT GmbH in Bühl is a company entered in the commercial register in 2015 that develops software with a focus on HMI (Human Machine Interfaces) on behalf of German industrial customers. SABO Mobile IT offers contract development of solutions in the sense of "Industry 4.0" for planning and supporting industrial production processes (e.g. at Daimler, Audi and VW) as well as for supplementing devices and machines in the fields of food technology, medical technology and mechanical engineering.

More information

Hochschule Heilbronn (HHN)

Heilbronn University of Applied Sciences (HHN) is a leading educational institution in Germany, known for its focus on applied science and technology. HHN prepares students for real-world challenges in various fields such as engineering, business administration, computer science and logistics. Prof. Dr.Jesser has been at Heilbronn University of Applied Sciences since 2013 and holds the professorship for Embedded Systems and Communications Engineering and is head of the Institute for Intelligent Cyber-Physical Systems. The ICPS is one of the leading research institute sat Heilbronn University and focuses intensively on the topics of Industry 4.0,the Internet of Things and artificial intelligence in the industrial environment.

More information

Grossenbacher Systeme

Grossenbacher Systeme GmbH develops and produces customer-specific electronics. For OEMs in industry and medical technology, it offers automation components such as controllers, touch displays, gateways and accessories based on a wide-ranging HW/SW modular system of HW and SW. Voice control is intended to make the modular system innovative and customer-oriented and the OEMs' products competitive - as a retrofit solution or as a design-in. Embedded AI as well as customized cyber security solutions will be added, as will remote update solutions.

More information