Research on Gesture Control Manipulator System based on Leap Motion

Abstract

With the rapid development of somatosensory controller, it is more and more difficult for traditional man-machine interaction to meet people's needs. So designing a robotic arm with gesture control, Leap Motion controller can be used to replace the traditional man-machine interaction mode. And collect hand data, after the gesture is analyzed and processed by computer, transmitted by ZigBee to the Arduino board, then robot arm is controlled to grasp objects by mimicking the movements of a human hand. The experimental results show that the system can control the robot arm in real time and simulate most of the movements of human arm more accurately, robot arm can be controlled remotely for rotating, grasping and other tasks. It can be applied to most situations that serve human life.