Distributed Online Convex Optimization Over Jointly Connected Digraphs

David Mateos-Nunez, Jorge Cortes
2014 IEEE Transactions on Network Science and Engineering  
This paper considers networked online convex optimization scenarios from a regret analysis perspective. At each round, each agent in the network commits to a decision and incurs in a local cost given by functions that are revealed over time and whose unknown evolution model might be adversarially adaptive to the agent's behavior. The goal of each agent is to incur a cumulative cost over time with respect to the sum of local functions across the network that is competitive with the best single
more » ... ntralized decision in hindsight. To achieve this, agents cooperate with each other using local averaging over timevarying weight-balanced digraphs as well as subgradient descent on the local cost functions revealed in the previous round. We propose a class of coordination algorithms that generalize distributed online subgradient descent and saddle-point dynamics, allowing proportional-integral (and higher-order) feedback on the disagreement among neighboring agents. We show that our algorithm design achieves logarithmic agent regret (when local objectives are strongly convex), or square-root agent regret (when local objectives are convex) in scenarios where the communication graphs are jointly connected. Simulations in a medical diagnosis application illustrate our results.
doi:10.1109/tnse.2014.2363554 fatcat:pjhbevopafh45anonjma3xs34y