A New Approach to Gesture Based Real-Time Robot Programming Using Mixed Reality

Abstract

While being increasingly used in larger industry companies, industrial robots have not yet prevailed in smaller enterprises. Not least, this is due to the time-consuming programming and the requirement for robotics experts. An intuitive control and programming concept can decisively reduce the need for expert knowledge. Using modern rendering software and innovative visualization frameworks, a gesture-based programming approach was developed at Karlsruhe University of Applied Sciences. Here, the user creates the robot program by virtually executing and chaining robot poses and gripper instructions. An evaluation shows the advantages of the developed concept and a comparison with competing methods.