TY - JOUR
T1 - Deep Reinforcement Learning-Based Mobility-Aware UAV Content Caching and Placement in Mobile Edge Networks
AU - Anokye, Stephen
AU - Ayepah-Mensah, Daniel
AU - Seid, Abegaz Mohammed
AU - Boateng, Gordon Owusu
AU - Sun, Guolin
N1 - Publisher Copyright:
© 2007-2012 IEEE.
PY - 2022/3/1
Y1 - 2022/3/1
N2 - With the proliferation of smart mobile devices, there is now an ever increasing craving for higher bandwidth for end user satisfaction. Increasing mobile traffic leads to congestion of backhaul networks. One promising solution to this problem is the mobile edge network and consequently mobile edge caching. There is an emerging paradigm shift toward the use of unmanned aerial vehicles (UAVs) to assist the traditional cellular networks and also to provide connectivity in places where there are no small base stations or faulty ones as a result of some natural disaster such as flooding. Hence, UAVs can be used to assist in content caching as well. This work proposes the use of human centric features, random waypoint user mobility model, and deep reinforcement learning to predict the location of the UAVs and the contents to cache at the UAVs. We formulated our problem as a Markov decision problem (MDP) and proposed a dueling reinforcement learning-based algorithm to solve the MDP problem.
AB - With the proliferation of smart mobile devices, there is now an ever increasing craving for higher bandwidth for end user satisfaction. Increasing mobile traffic leads to congestion of backhaul networks. One promising solution to this problem is the mobile edge network and consequently mobile edge caching. There is an emerging paradigm shift toward the use of unmanned aerial vehicles (UAVs) to assist the traditional cellular networks and also to provide connectivity in places where there are no small base stations or faulty ones as a result of some natural disaster such as flooding. Hence, UAVs can be used to assist in content caching as well. This work proposes the use of human centric features, random waypoint user mobility model, and deep reinforcement learning to predict the location of the UAVs and the contents to cache at the UAVs. We formulated our problem as a Markov decision problem (MDP) and proposed a dueling reinforcement learning-based algorithm to solve the MDP problem.
KW - Mobile edge caching
KW - Mobile edge network (MEN)
KW - Reinforcement learning (RL)
KW - Unmanned aerial vehicle (UAV)
UR - http://www.scopus.com/inward/record.url?scp=85111028628&partnerID=8YFLogxK
U2 - 10.1109/JSYST.2021.3082837
DO - 10.1109/JSYST.2021.3082837
M3 - Article
AN - SCOPUS:85111028628
SN - 1932-8184
VL - 16
SP - 275
EP - 286
JO - IEEE Systems Journal
JF - IEEE Systems Journal
IS - 1
ER -