Programming Industrial Cobots using Natural User Interaction

Abstract

Cobots are the key element of the industrial revolution. They collaborate with humans to perform repetitive tasks. Currently, cobots are being trained using Teach pendant and Lead through methods. These methods are very hectic, difficult, and costly, highly skilled labor is also required to perform these methods. This project aims to minimize these difficulties by providing a rapid programming model, that consists of a platform to train cobots using natural user interactions. The project will involve a Kinect sensor to obtain user interactions (hand gestures and verbal commands). The system will propose a solution using the inputs obtained from the Kinect sensor. This proposed solution is hybrid in which the UR robot (cobot) is simulated in WEBOTS/UR Virtual Machine that is controlled by a human in the real-world through natural user interactions. The use of a simulated environment is because of the non-availability of the physical UR Cobot.