ILP-M Conv: Optimize Convolution Algorithm for Single-Image Convolution Neural Network Inference on Mobile GPUs [article]

Zhuoran Ji
2019 arXiv   pre-print
Convolution neural networks are widely used for mobile applications. However, GPU convolution algorithms are designed for mini-batch neural network training, the single-image convolution neural network inference algorithm on mobile GPUs is not well-studied. After discussing the usage difference and examining the existing convolution algorithms, we proposed the HNTMP convolution algorithm. The HNTMP convolution algorithm achieves 14.6 × speedup than the most popular im2col convolution algorithm,
more » ... and 2.30 × speedup than the fastest existing convolution algorithm (direct convolution) as far as we know.
arXiv:1909.02765v2 fatcat:tfof36jde5dk7axe7t7zneidby