Analysis, Design and Evaluation of a High-Performance Stochastic Multilayer Perceptron: from Mini-Batch Training to Inference [post]

Ziheng Wang, Farzad Niknia, Shanshan Liu, Pedro Reviriego, Fabrizio Lombardi
2022 unpublished
<p>The mini-batch technique is widely used in neural network training with conventional arithmetic for its efficiency; however, its feasibility and performance in SC MLPs have rarely been studied. This paper analyzes by theory and simulation the performance of the mini-batch technique in SC MLPs; the results show that it potentially has a larger benefit in MLPs using SC than the conventional version. Moreover, a pipelined SC MLP implementation is also pursued in this paper for performing the
more » ... erence process. All findings and designs provided in this paper leverage the advantages of the mini-batch technique and SC implementation to design high-performance MLPs. </p>
doi:10.36227/techrxiv.21251418.v1 fatcat:zeubpcnnxzecxjtn7ko3yugeny