PMID- 32708559
OWN - NLM
STAT- PubMed-not-MEDLINE
LR  - 20200818
IS  - 1424-8220 (Electronic)
IS  - 1424-8220 (Linking)
VI  - 20
IP  - 14
DP  - 2020 Jul 16
TI  - Gateway Selection in Millimeter Wave UAV Wireless Networks Using Multi-Player 
      Multi-Armed Bandit.
LID - 10.3390/s20143947 [doi]
LID - 3947
AB  - Recently, unmanned aerial vehicle (UAV)-based communications gained a lot of 
      attention due to their numerous applications, especially in rescue services in 
      post-disaster areas where the terrestrial network is wholly malfunctioned. 
      Multiple access/gateway UAVs are distributed to fully cover the post-disaster 
      area as flying base stations to provide communication coverage, collect valuable 
      information, disseminate essential instructions, etc. The access UAVs after 
      gathering/broadcasting the necessary information should select and fly towards 
      one of the surrounding gateways for relaying their information. In this paper, 
      the gateway UAV selection problem is addressed. The main aim is to maximize the 
      long-term average data rates of the UAVs relays while minimizing the flights' 
      battery cost, where millimeter wave links, i.e., using 30~300 GHz band, employing 
      antenna beamforming, are used for backhauling. A tool of machine learning (ML) is 
      exploited to address the problem as a budget-constrained multi-player multi-armed 
      bandit (MAB) problem. In this setup, access UAVs act as the players, and the arms 
      are the gateway UAVs, while the rewards are the average data rates of the 
      constructed relays constrained by the battery cost of the access UAV flights. In 
      this decentralized setting, where information is neither prior available nor 
      exchanged among UAVs, a selfish and concurrent multi-player MAB strategy is 
      suggested. Towards this end, three battery-aware MAB (BA-MAB) algorithms, namely 
      upper confidence bound (UCB), Thompson sampling (TS), and the exponential weight 
      algorithm for exploration and exploitation (EXP3), are proposed to realize 
      gateways selection efficiently. The proposed BA-MAB-based gateway UAV selection 
      algorithms show superior performance over approaches based on near and random 
      selections in terms of total system rate and energy efficiency.
FAU - Mohamed, Ehab Mahmoud
AU  - Mohamed EM
AUID- ORCID: 0000-0001-5443-9711
AD  - Electrical Engineering Department, College of Engineering, Prince Sattam Bin 
      Abdulaziz University, Wadi Addwasir 11991, Saudi Arabia.
AD  - Electrical Engineering Department, Faculty of Engineering, Aswan University, 
      Aswan 81542, Egypt.
FAU - Hashima, Sherief
AU  - Hashima S
AUID- ORCID: 0000-0002-4443-7066
AD  - Computational Learning Theory Team, RIKEN-Advanced Intelligent Project, Fukuoka 
      819-0395, Japan.
AD  - Engineering and Scientific Equipment's Department, Egyptian Atomic Energy 
      Authority, Cairo, Inshas 13759, Egypt.
FAU - Aldosary, Abdallah
AU  - Aldosary A
AD  - Department of Computer Science, Prince Sattam bin Abdulaziz University, As 
      Sulayyil 11991, Saudi Arabia.
FAU - Hatano, Kohei
AU  - Hatano K
AD  - Computational Learning Theory Team, RIKEN-Advanced Intelligent Project, Fukuoka 
      819-0395, Japan.
AD  - Faculty of Arts and Science, Kyushu University, Fukuoka 819-0395, Japan.
FAU - Abdelghany, Mahmoud Ahmed
AU  - Abdelghany MA
AD  - Electrical Engineering Department, College of Engineering, Prince Sattam Bin 
      Abdulaziz University, Wadi Addwasir 11991, Saudi Arabia.
AD  - Electrical Engineering Department, Faculty of Engineering, Minia University, 
      Minia 61519, Egypt.
LA  - eng
GR  - #2019/01/9927/Deanship of Scientific Research at Prince Sattam Bin Abdulaziz 
      University/
PT  - Journal Article
DEP - 20200716
PL  - Switzerland
TA  - Sensors (Basel)
JT  - Sensors (Basel, Switzerland)
JID - 101204366
SB  - IM
PMC - PMC7411621
OTO - NOTNLM
OT  - machine learning
OT  - millimeter wave
OT  - multi-armed bandit
OT  - unmanned aerial vehicles
COIS- The authors declare no conflict of interest.
EDAT- 2020/07/28 06:00
MHDA- 2020/07/28 06:01
PMCR- 2020/07/01
CRDT- 2020/07/26 06:00
PHST- 2020/06/02 00:00 [received]
PHST- 2020/07/06 00:00 [revised]
PHST- 2020/07/14 00:00 [accepted]
PHST- 2020/07/26 06:00 [entrez]
PHST- 2020/07/28 06:00 [pubmed]
PHST- 2020/07/28 06:01 [medline]
PHST- 2020/07/01 00:00 [pmc-release]
AID - s20143947 [pii]
AID - sensors-20-03947 [pii]
AID - 10.3390/s20143947 [doi]
PST - epublish
SO  - Sensors (Basel). 2020 Jul 16;20(14):3947. doi: 10.3390/s20143947.