Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach

Abegaz Mohammed Seid, Gordon Owusu Boateng, Stephen Anokye, Thomas Kwantwi, Guolin Sun*, Guisong Liu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

186 Citations (Scopus)

Abstract

In the fifth-generation (5G) wireless networks, Edge-Internet-of-Things (EIoT) devices are envisioned to generate huge amounts of data. Due to the limitation of computation capacity and battery life of devices, all tasks cannot be processed by these devices. However, mobile-edge computing (MEC) is a very promising solution enabling offloading of tasks to nearby MEC servers to improve quality of service. Also, during emergency situations in areas where network failure exists, unmanned aerial vehicles (UAVs) can be deployed to restore the network by acting as Aerial Base Stations and computational nodes for the edge network. In this article, we consider a central network controller who trains observations and broadcasts the trained data to a multi-UAV cluster network. Each UAV cluster head acts as an agent and autonomously allocates resources to EIoT devices in a decentralized fashion. We propose model-free deep reinforcement learning (DRL)-based collaborative computation offloading and resource allocation (CCORA-DRL) scheme in an aerial to ground (A2G) network for emergency situations, which can control the continuous action space. Each agent learns efficient computation offloading policies independently in the network and checks the statuses of the UAVs through Jain's Fairness index. The objective is minimizing task execution delay and energy consumption and acquiring an efficient solution by adaptive learning from the dynamic A2G network. Simulation results reveal that our scheme through deep deterministic policy gradient, effectively learns the optimal policy, outperforming A3C, deep $Q$ -network and greedy-based offloading for local computation in stochastic dynamic environments.

Original languageEnglish
Article number9366889
Pages (from-to)12203-12218
Number of pages16
JournalIEEE Internet of Things Journal
Volume8
Issue number15
DOIs
Publication statusPublished - 1 Aug 2021
Externally publishedYes

Keywords

  • Collaborative computation offloading
  • deep reinforcement learning (DRL)
  • Edge Internet of Things (EIoT)
  • IoT network
  • multi-UAV network
  • resource allocation

Fingerprint

Dive into the research topics of 'Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach'. Together they form a unique fingerprint.

Cite this