Benefits for the users

Affective manufacturing leads to improved efficiency and productivity, by incorporating human stress factors in the optimization of the production processes. The performance of a process depends on the complexity of tasks and the arousal level the operator experiences. For simple tasks, low arousal (inattention of the operator) leads to poor performance, high arousal leads to high performance. Difficult tasks however require moderate arousal for optimum performance. A too low arousal (inattention or drowsy) as well as a too high arousal (stress) lead to poor performance and should be avoided.

Affective manufacturing leads to improved product quality. One of the requests is error-free production through a self-learning production method in which the system responds autonomously to any errors. The addition of affective strategies will further be strengthening this self-learning and will cause a paradigm shift in smart manufacturing. It will create higher standards of production, and more operator and happiness.

Affective manufacturing leads to improved safety, by preventing under-alertness or drowsiness.

Affective manufacturing leads to improved self-control and operator satisfaction/happiness

Innovation

Mentech and Tegema demonstrate an affective production platform for high-quality production of low-volume high-mix products. The demonstration is based on a modular machine platform with robotics functionalities for efficient and customized production of complex photonic devices. The platform integrates operator stress monitoring to harmonize productivity and operator happiness.

 

The platform comprises a pick-to-light module and a cobot module for cobot-assisted assembly. The pick-to-light module consists of several manufacturing bins with LED indicators to guide the operator through the assembly tasks. The sequence of assembly is indicated by the subsequent switching on and off the LED indicators. The bins also contain proximity sensors to measure the completion of the different assembly tasks. A cobot platform is integrated in the assembly line to assist the operator with complex assembly tasks. Multiple assembly sequences can be uploaded to the system, making the system a flexible manufacturing platform.

 

The operator stress is determined from real-time measured stress features, like heartrate, skin conductance and face expressions. A trained neural network model makes a prediction of the stress levels of an operator during assembly based on the measured physiology and recognized patterns.

 

A dashboard visualizes the system metrics, like the required time for assembly tasks, assembly errors and cobot performance, and the measured operator stress. Based on the dashboard outcome, system and operator interventions can be initiated.

 

The AMS showcases that a hybrid manufacturing platform with a decision algorithm based on operator stress levels will harmonize production and increase yield and production quality.

Risks and limitations

Stress measurement – the measurement of distinct stress levels is difficult in a dynamic high-tech environment. Mentech has a lot of experience with the development and training of personalized stress models. The stress model used in the Affective manufacturing system were trained with personal data obtained in a well-conditioned reference setting. After training, the model was applied to the operator setting. Operator Acceptance - Measuring operator physiology can also backfire. He or she may experience this as a check by the manager. The merits of operator stress measurement are both operator/machine safety and productivity. Particularly, safety is a key selling feature for acceptance of stress detection. Reliability / Accuracy - The stress detection models must be accurate enough to be integrated as a feature for increased safety and productivity. Inaccurate predictions of stress levels might lead to reduced productivity of reduced safety. The development and training of models in reference setting, with the addition of face expression, contributes to accurate stress detection capability. Acceptance by operator – The affective manufacturing system will not be accepted by the operator/customer. The benefits of stress detection, also for operator safety and happiness, need to be made explicit. The privacy of operators need to be secured via a privacy statement.

Technology readiness level

6 - Safety approved sensors and systems are commercially available

Sectors of application

Tooling industry: equipment manufacturers (OEM), addition of human-machine interface to improved product quality and system productivity |, Transportation industry: manufacturers of cars/trucks/busses/trains/planes/etc., including affective strategies for road safety and driving performance (economics like action radius and energy consumption, passenger comfort), Making and processing / food industry: optimization of production, increase of operator engagement (happiness and arousal), Labour-intensive industries, with operators with a mild intellectual disability, labour-assisted manufacturing .

Potential sectors of application

All segments in which human-machine interfaces are relevant, like manufacturing, system control, production control, operation of machines and systems.

Hardware / Software

Hardware:

Cobot-assisted Pick to light assembly unit with manufacturing bins, consisting of control electronics and software, LED indicators, proximity sensors and assembly tools for complex products; with an integrated Cobot assembly unit.

Software:

HUME stress detection platform, consisting of wearables and trained models (operating in the cloud), optionally a camera system for face recognition and stress detection can be integrated.

Dashboard which visualizes the production metrics (like productivity, production times, production errors) and operator stress levels.

Video

Smart factory concept, for robotics-based manufacturing of complex photonic products, with in-line operator stress detection for safety and optimized production in terms of yield and product quality.

https://www.youtube.com/watch?v=2eOMwksg5sc&t=3s

Documents

use-cases-AMS-Mentech-Tegema-1.pdf