Visualizing Transfer Learning [article]

Róbert Szabó, Dániel Katona, Márton Csillag, Adrián Csiszárik, Dániel Varga
2020 arXiv   pre-print
We provide visualizations of individual neurons of a deep image recognition network during the temporal process of transfer learning. These visualizations qualitatively demonstrate various novel properties of the transfer learning process regarding the speed and characteristics of adaptation, neuron reuse, spatial scale of the represented image features, and behavior of transfer learning to small data. We publish the large-scale dataset that we have created for the purposes of this analysis.
arXiv:2007.07628v1 fatcat:ej326ne33vdpvm6yzrfccbfxci