AR-based Operator support in HRC
Main functionalities
The AR based Operator support module aims to increase human operator safety awareness, during human robot collaborative assembly tasks. The developed AR Application supports the human operator during the assembly process, through visual signals and notifications, in order to be aware of the execution status of every operation and the status of every resource, see figure below. Furthermore, this module provides to the operator the ability to navigate the mobile robot if considered necessary.
AR Application functionalities
Technical specifications
The application is developed using the Unity3D game engine to cover the communication and the visualization needs, and the Vuforia library, to realize the AR functionality. The main advantage offered by the Unity3D software, apart from the ease of use, is the possibility of exporting the same application to different platforms (Android, iOS, Windows). Taking into consideration that the hardware is running either Android (Epson Moverio BT200 AR glasses, etc.) or Windows (HoloLens AR glasses), this is a really helpful feature to run, test and evaluate the same application to multiple devices.
Inputs and outputs
The Augmented Reality Operator Support Application uses a set of input data from the system to provide the aforementioned functionalities to the operators. The required input data are listed below:
List of assembly tasks that need to be executed
Assigned resource for each task
Assembly instructions
System recovery instructions
Dimensions of robot safe working volumes
The Augmented Reality Operator Support Application provides a set of outputs:
Assembly instructions
Robot behaviour information for increasing safety awareness
Safe working volumes
Production status information
Formats and standards
Standards: ISO / TS 15066:2016 Robots and robotic devices – Collaborative robot,
Formats: Web standards, XML / JSON format
Owner (organization)
LMS – University of Patras
Trainings
To learn more about the solution, click on the link below to access the training on the Moodle platform
AR-based Operator Support in HRC