Baseball pitch type recognition based on broadcast videos

Abstract

In this paper, we report our work on baseball pitch type recognition based on broadcast videos using two-stream inflated 3D convolutional neural network (I3D). To improve the state-of-the-art of research, we developed our own high-quality dataset, trained and tuned the I3D model extensively, primarily combating the problem of overfitting while still trying to improve final validation accuracy. In the end, we are able to achieve an accuracy of 53.43% ± 3.04% when oversampling and 57.10% ± 2.99% when not oversampling, which is a significant improvement over the published best result of an accuracy of 36.4% on the same six pitch type classes.