Affective Manufacturing System
Name of demonstration
Affective Manufacturing System
The objective of the project is to demonstrate a smart factory concept, for robotics-based manufacturing of complex photonic products, with in-line operator stress detection for safety and optimized production (in terms of yield and product quality). The demonstration is based on a modular machine platform with robotics functionalities for efficient and customized production of complex photonic systems. The platform has in-line monitoring and quality control functionalities for in-line adaption of production steps. The demonstration includes an appealing showcase in which human factors are successfully included in the execution of a manufacturing process for optimized production, eventually to open the gateway for affective cobots.
A robot can take over complex tasks, making the assembly process safer, faster and qualitatively better. The downside of working with a cobot is that the potential loss of control can cause stress for the operator. And stress has a negative impact on well-being, safety and productivity.
The affective manufacturing system has an integrated robotics system for manufacturing of complex photonic systems and contains a sensor system for in-line process monitoring. The platform integrates a novel operator stress detection module, based on measured physiological features of the operator, and artificial intelligence algorithm for stress detection. Production performance and related operator stress is displayed on an interactive dashboard, used for both stress management and process control.
The measured stress levels are used in a smart decision algorithm that takes into account all relevant decision factors, such as the stress indications (emotional state) of the individual operators as determined by the measured and analyzed features; information about circumstances (private, work) of the employee; information about the production process, such as the measured performance indicators (product quality, productivity, failure, etc.); and production instructions (such as the complexity of the instruction or work).
Owner of the demonstrator
Erwin Meinders email@example.com
C28 - Manufacture of machinery and equipment n.e.c.
Stress management, wearables, artificial intelligence, cobot assisted manufacturing, affective manufacturing.
Benefits for the users
Affective manufacturing leads to improved efficiency and productivity, by incorporating human stress factors in the optimization of the production processes. The performance of a process depends on the complexity of tasks and the arousal level the operator experiences. For simple tasks, low arousal (inattention of the operator) leads to poor performance, high arousal leads to high performance. Difficult tasks however require moderate arousal for optimum performance. A too low arousal (inattention or drowsy) as well as a too high arousal (stress) lead to poor performance and should be avoided.
Affective manufacturing leads to improved product quality. One of the requests is error-free production through a self-learning production method in which the system responds autonomously to any errors. The addition of affective strategies will further be strengthening this self-learning and will cause a paradigm shift in smart manufacturing. It will create higher standards of production, and more operator and happiness.
Affective manufacturing leads to improved safety, by preventing under-alertness or drowsiness.
Affective manufacturing leads to improved self-control and operator satisfaction/happiness
Mentech and Tegema demonstrate an affective production platform for high-quality production of low-volume high-mix products. The demonstration is based on a modular machine platform with robotics functionalities for efficient and customized production of complex photonic devices. The platform integrates operator stress monitoring to harmonize productivity and operator happiness.
The platform comprises a pick-to-light module and a cobot module for cobot-assisted assembly. The pick-to-light module consists of several manufacturing bins with LED indicators to guide the operator through the assembly tasks. The sequence of assembly is indicated by the subsequent switching on and off the LED indicators. The bins also contain proximity sensors to measure the completion of the different assembly tasks. A cobot platform is integrated in the assembly line to assist the operator with complex assembly tasks. Multiple assembly sequences can be uploaded to the system, making the system a flexible manufacturing platform.
The operator stress is determined from real-time measured stress features, like heartrate, skin conductance and face expressions. A trained neural network model makes a prediction of the stress levels of an operator during assembly based on the measured physiology and recognized patterns.
A dashboard visualizes the system metrics, like the required time for assembly tasks, assembly errors and cobot performance, and the measured operator stress. Based on the dashboard outcome, system and operator interventions can be initiated.
The AMS showcases that a hybrid manufacturing platform with a decision algorithm based on operator stress levels will harmonize production and increase yield and production quality.
Risks and limitations
Stress measurement – the measurement of distinct stress levels is difficult in a dynamic high-tech environment. Mentech has a lot of experience with the development and training of personalized stress models. The stress model used in the Affective manufacturing system were trained with personal data obtained in a well-conditioned reference setting. After training, the model was applied to the operator setting. Operator Acceptance - Measuring operator physiology can also backfire. He or she may experience this as a check by the manager. The merits of operator stress measurement are both operator/machine safety and productivity. Particularly, safety is a key selling feature for acceptance of stress detection. Reliability / Accuracy - The stress detection models must be accurate enough to be integrated as a feature for increased safety and productivity. Inaccurate predictions of stress levels might lead to reduced productivity of reduced safety. The development and training of models in reference setting, with the addition of face expression, contributes to accurate stress detection capability. Acceptance by operator – The affective manufacturing system will not be accepted by the operator/customer. The benefits of stress detection, also for operator safety and happiness, need to be made explicit. The privacy of operators need to be secured via a privacy statement.
Technology readiness level
6 - Safety approved sensors and systems are commercially available
Sectors of application
Tooling industry: equipment manufacturers (OEM), addition of human-machine interface to improved product quality and system productivity |, Transportation industry: manufacturers of cars/trucks/busses/trains/planes/etc., including affective strategies for road safety and driving performance (economics like action radius and energy consumption, passenger comfort), Making and processing / food industry: optimization of production, increase of operator engagement (happiness and arousal), Labour-intensive industries, with operators with a mild intellectual disability, labour-assisted manufacturing .
Potential sectors of application
All segments in which human-machine interfaces are relevant, like manufacturing, system control, production control, operation of machines and systems.
Hardware / Software
Cobot-assisted Pick to light assembly unit with manufacturing bins, consisting of control electronics and software, LED indicators, proximity sensors and assembly tools for complex products; with an integrated Cobot assembly unit.
HUME stress detection platform, consisting of wearables and trained models (operating in the cloud), optionally a camera system for face recognition and stress detection can be integrated.
Dashboard which visualizes the production metrics (like productivity, production times, production errors) and operator stress levels.
Smart factory concept, for robotics-based manufacturing of complex photonic products, with in-line operator stress detection for safety and optimized production in terms of yield and product quality.https://www.youtube.com/watch?v=2eOMwksg5sc&t=3s
Additive TiG welding
The module uses a KUKA robot to perform metal additive manufacturing of thin wall structures using TIG weld...
AR-based Operator support in HRC
The AR based Operator support module aims to increase human operator safety awareness, during human robot c...
Automatic reconfiguration of flexible fixtures
The module can be used to mount multiple workpieces onto a fixturing system constructed from two or more St...
Connecting Virtual Model With The Physical Model
The module describes how robots and other machines can be connected together, through an information server...
Depth-sensor Safety Model for HRC
Depth-based safety model for human-robot collaboration: Generates three different spatial zones in the shar...