Siamese Spatio-Temporal Convolutional Neural Network for Stroke Classification in Table Tennis Games

Pierre-Etienne Martin, Jenny Benois-Pineau, Boris Mansencal, Renaud Péteri, Julien Morlier
2019 MediaEval Benchmarking Initiative for Multimedia Evaluation  
This work presents a Table Tennis stroke classification approach through a siamese spatio-temporal convolutional neural network -SSTCNN. The videos are recorded at 120 frames per second with players performing in natural conditions. The frames are extracted, resized and processed to compute the optical flow. From the optical flow, a region of interest -ROI -is inferred. The SSTCNN is then feed by RGB and optical flow ROIs stream to give a probabilistic classification over all the table tennis
more » ... rokes. Optical Flow estimator As shown in [7], flow estimators can have a strong impact on the classification, so we tested classification using two different flow estimators: DeepFlow [9] and Dense Inversive Search -DIS [2].
dblp:conf/mediaeval/MartinBMPM19 fatcat:ey4ra6s7ynaijc3jhv6ir4sjv4