Dropout during inference as a model for neurological degeneration in an image captioning network [article]

Bai Li, Ran Zhang, Frank Rudzicz
2018 arXiv   pre-print
We replicate a variation of the image captioning architecture by Vinyals et al. (2015), then introduce dropout during inference mode to simulate the effects of neurodegenerative diseases like Alzheimer's disease (AD) and Wernicke's aphasia (WA). We evaluate the effects of dropout on language production by measuring the KL-divergence of word frequency distributions and other linguistic metrics as dropout is added. We find that the generated sentences most closely approximate the word frequency
more » ... stribution of the training corpus when using a moderate dropout of 0.4 during inference.
arXiv:1808.03747v1 fatcat:dnvqy53mmbfpjn2avj6tr7lcaa