Detecting Deepfake Voice Using Explainable Deep Learning Techniques

Suk-Young Lim, Dong-Kyu Chae, Sang-Chul Lee
2022 Applied Sciences  
Fake media, generated by methods such as deepfakes, have become indistinguishable from real media, but their detection has not improved at the same pace. Furthermore, the absence of interpretability on deepfake detection models makes their reliability questionable. In this paper, we present a human perception level of interpretability for deepfake audio detection. Based on their characteristics, we implement several explainable artificial intelligence (XAI) methods used for image classification
more » ... on an audio-related task. In addition, by examining the human cognitive process of XAI on image classification, we suggest the use of a corresponding data format for providing interpretability. Using this novel concept, a fresh interpretation using attribution scores can be provided.
doi:10.3390/app12083926 fatcat:vjuwm2j4jbhtrgxgb3v6sufwya