AR-based Operator support in HRC

Main functionalities

The AR based Operator support module aims to increase human operator safety awareness, during human robot collaborative assembly tasks. The developed AR Application supports the human operator during the assembly process, through visual signals and notifications, in order to be aware of the execution status of every operation and the status of every resource, see figure below. Furthermore, this module provides to the operator the ability to navigate the mobile robot if considered necessary.

AR Application functionalities

Technical specifications

The application is developed using the Unity3D game engine to cover the communication and the visualization needs, and the Vuforia library, to realize the AR functionality. The main advantage offered by the Unity3D software, apart from the ease of use, is the possibility of exporting the same application to different platforms (Android, iOS, Windows). Taking into consideration that the hardware is running either Android (Epson Moverio BT200 AR glasses, etc.) or Windows (HoloLens AR glasses), this is a really helpful feature to run, test and evaluate the same application to multiple devices.

Inputs and outputs

The Augmented Reality Operator Support Application uses a set of input data from the system to provide the aforementioned functionalities to the operators. The required input data are listed below:
List of assembly tasks that need to be executed
Assigned resource for each task
Assembly instructions
System recovery instructions
Dimensions of robot safe working volumes

The Augmented Reality Operator Support Application provides a set of outputs:
Assembly instructions
Robot behaviour information for increasing safety awareness
Safe working volumes
Production status information

Formats and standards

Standards: ISO / TS 15066:2016 Robots and robotic devices – Collaborative robot,
Formats: Web standards, XML / JSON format

Owner (organization)

LMS – University of Patras


To learn more about the solution, click on the link below to access the training on the Moodle platform
AR-based Operator Support in HRC

Subscribe to newsletter

Please subscribe to our mailing list to be the first one informed about the new open calls, events and other hot news!

    Please check if the email you entered is correct
    All done!

    Your have successfully subscribed to Trinity newsletter.