Gesture recognition based teleoperation framework of robotic fish

Jinpeng Mi, Yu Sun, Yu Wang, Zhen Deng, Liang Li, Jianwei Zhang, Guanming Xie
2016 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO)  
Robots attract strong interest from human beings, and ordinary people seriously expect to acquire intuitive understanding from the process of interacting with robots. In this paper, a teleoperation framework based on gesture recognition was developed and the recognized human gestures were mapped to corresponding swimming behaviors of underwater robotic fish. By this means, the robotic fish can be remotely controlled by hand gestures. Most significantly, the teleoperation framework offers the
more » ... ortunity for onlookers to directly interact with the robotic fish, and the intuitive experience of onlookers about human-robot interaction can be augmented. Compared with traditional control structures of underwater robotic fish systems, the presented teleoperation framework can be built quickly, the influence of light condition can be eliminated entirely, and the onlookers can interact with robotic fish directly rather than need to learn about the system architecture and control strategy. Several tests were taken in a water pool to verify the performance of the presented teleoperation framework. The experimental results showed that the developed teleoperation framework is suitable for remote controlling underwater robotic fish, and the teleoperation framework can be widely applied to other application scenarios. The experiment setup was exhibited in IROS2015, Hamburg, the described teleoperation framework greatly attracted onlooker's interest.
doi:10.1109/robio.2016.7866311 dblp:conf/robio/MiSWDLZX16 fatcat:c553vs3i2faf3m2yujjmmjq24q