User-specific assistance in manual procedures using speech-based interaction

Research Paper

Machine operators will continue to play an important role in future production environment due to their flexibility and creativity. In addition to machine operation, the tasks of machine operators consist of maintenance and changeover procedures, refilling consumables, and detecting and correcting errors in the machine. These tasks, as well as the potentially dangerous working environment, need continuous visual attention. Speech-based interaction is thus a promising approach to assist machine operators. It allows to access information anywhere, without requiring visual attention. This paper describes a speech-based system that supports operators in performing manual maintenance and changeover tasks. The system can be easily adapted to specific procedures and user groups to equally support users with different abilities, for example, in terms of perception or work experience. The adaptation of the system is controlled by models that describe the input vocabulary, the user, and the current procedure.

The research paper is available only in German language.