In this paper, we propose a hand gesture recognition framework to control an indoor wheeled mobile robot. Our method combines hand shapes and arm poses to recognize human upper body gestures across various operation scenarios for a wheeled mobile robo...
In this paper, we propose a hand gesture recognition framework to control an indoor wheeled mobile robot. Our method combines hand shapes and arm poses to recognize human upper body gestures across various operation scenarios for a wheeled mobile robot. The YOLOv8m model is utilized for hand shape recognition, and a YOLOv8mpose model is used to mitigate misrecognition. An algorithm based on arm length ratios and angles distinguishes a person’s upper body posture. The hand gesture recognition framework is deployed on a Jetson Orin Nano environment using an Intel RealSense D455f camera. The results of the recognized gestures are sent to the wheeled mobile robot, and the robot is implemented to move based on the information from the recognized gestures. This approach offers high accessibility, enabling mobile robot control using hand gestures without any physical user interface.