DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns [article]

Jiazhen Gu, Huan Liu, Yangfan Zhou, Xin Wang
2017 arXiv   pre-print
Deep learning applications are computation-intensive and often employ GPU as the underlying computing devices. Deep learning frameworks provide powerful programming interfaces, but the gap between source codes and practical GPU operations make it difficult to analyze the performance of deep learning applications. In this paper, through examing the features of GPU traces and deep learning applications, we use the suffix tree structure to extract the repeated patten in GPU traces. Performance
more » ... ysis graphs can be generated from the preprocessed GPU traces. We further present DeepProf, a novel tool to automatically process GPU traces and generate performance analysis reports for deep learning applications. Empirical study verifies the effectiveness of DeepProf in performance analysis and diagnosis. We also find out some interesting properties of Tensorflow, which can be used to guide the deep learning system setup.
arXiv:1707.03750v1 fatcat:4qclasz5krgcfh4a25hhsu6rdu