Deep learning based gesture recognition and its application in interactive control of intelligent wheelchair

Abstract

With the development of robotics technology, new human-robot interaction technology has gradually received more and more attention. Bioelectric-based gesture recognition, which is to be studied in this article, has become a frontier subject of new human-robot interaction because of its natural and intuitive information representation function and it is not restricted from complex background conditions. A deep neural network model based on the Alexnet-based network structure is used for gesture recognition based on sEMG (surface electromyography) and inertial information. The data is collected by the sliding window method, the recognition thread loads the trained model and performs online recognition in real time. Moreover, in order to improve the robustness of the algorithm to the input data, a verification model based on the twin neural network is used to verify whether the input data belongs to the identification type. And the human-robot interaction method proposed is verified on the omnidirectional intelligent wheelchair, and the obvious control effect is obtained.