Reinforcement Learning, Spike-Time-Dependent Plasticity, and the BCM Rule

Dorit Baras, Ron Meir
2007 Neural Computation  
Learning agents, whether natural or artificial, must update their internal parameters in order to improve their behavior over time. In reinforcement learning, this plasticity is influenced by an environmental signal, termed a reward, that directs the changes in appropriate directions. We apply a recently introduced policy learning algorithm from machine learning to networks of spiking neurons and derive a spike-time-dependent plasticity rule that ensures convergence to a local optimum of the
more » ... l optimum of the expected average reward. The approach is applicable to a broad class of neuronal models, including the Hodgkin-Huxley model. We demonstrate the effectiveness of the derived rule in several toy problems. Finally, through statistical analysis, we show that the synaptic plasticity rule established is closely related to the widely used BCM rule, for which good biological evidence exists.
doi:10.1162/neco.2007.19.8.2245 pmid:17571943 fatcat:sodvrgjedzhfnh57hg5uspem7q