Hippocampal replays under the scrutiny of reinforcement learning models

Romain Cazé, Mehdi Khamassi, Lise Aubin, Benoît Girard
2018 Journal of Neurophysiology  
Multiple in vivo studies have shown that place cells from the hippocampus replay previously experienced trajectories. These replays are commonly considered to mainly reflect memory consolidation processes. Some data, however, have highlighted a functional link between replays and reinforcement learning (RL). This theory, extensively used in machine learning, has introduced efficient algorithms and can explain various behavioral and physiological measures from different brain regions. RL
more » ... ms could constitute a mechanistic description of replays and explain how replays can reduce the number of iterations required to explore the environment during learning. We review the main findings concerning the different hippocampal replay types and the possible associated RL models (either model-based, modelfree, or hybrid model types). We conclude by tying these frameworks together. We illustrate the link between data and RL through a series of model simulations. This review, at the frontier between informatics and biology, paves the way for future work on replays. activity replay; computational modeling; hippocampus; model free/model based; place cells; reinforcement learning; sleep
doi:10.1152/jn.00145.2018 pmid:30303758 fatcat:kotrcux5hrbytjr2lhzvnpfyuy