A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2016; you can also visit <a rel="external noopener" href="http://dept.stat.lsa.umich.edu:80/~tewaria/research/tewari16ads.pdf">the original URL</a>. The file type is <code>application/pdf</code>.
<i title="Springer International Publishing">
The first paper on contextual bandits was written by Michael Woodroofe in 1979  but the term "contextual bandits" was invented only recently in 2008 by Langford and Zhang . Woodroofe's motivating application was clinical trials whereas modern interest in this problem was driven to a great extent by problems on the internet, such as online ad and online news article placement. We have now come full circle because contextual bandits provide a natural framework for sequential decision making<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-51394-2_25">doi:10.1007/978-3-319-51394-2_25</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/zjto7w26v5fpvcbhpvlo5v7kha">fatcat:zjto7w26v5fpvcbhpvlo5v7kha</a> </span>
more »... in mobile health. We will survey the contextual bandits literature with a focus on modifications needed to adapt existing approaches to the mobile health setting. We discuss specific challenges in this direction such as: good initialization of the learning algorithm, finding interpretable policies, assessing usefulness of tailoring variables, computational considerations, robustness to failure of assumptions, and dealing with variables that are costly to acquire or missing.
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20160910133823/http://dept.stat.lsa.umich.edu:80/~tewaria/research/tewari16ads.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5a/dc/5adc1ac7a54c773750eec6408692816861732f14.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-51394-2_25"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> springer.com </button> </a>