DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks [article]

Haixia Peng, Xuemin Shen
2020 arXiv   pre-print
In this paper, we investigate joint vehicle association and multi-dimensional resource management in a vehicular network assisted by multi-access edge computing (MEC) and unmanned aerial vehicle (UAV). To efficiently manage the available spectrum, computing, and caching resources for the MEC-mounted base station and UAVs, a resource optimization problem is formulated and carried out at a central controller. Considering the overlong solving time of the formulated problem and the sensitive delay
more » ... equirements of vehicular applications, we transform the optimization problem using reinforcement learning and then design a deep deterministic policy gradient (DDPG)-based solution. Through training the DDPG-based resource management model offline, optimal vehicle association and resource allocation decisions can be obtained rapidly. Simulation results demonstrate that the DDPG-based resource management scheme can converge within 200 episodes and achieve higher delay/quality-of-service satisfaction ratios than the random scheme.
arXiv:2009.03721v1 fatcat:xtwhyra5cjgbtm3n6c5qx6ksa4