Learning to Rest: A Q-Learning Approach to Flying Base Station Trajectory Design with Landing Spots

By Harald Bayerlein, Rajeev Gangula, David Gesbert. 2018

22 citations recorded by the source corpus.

We consider the problem of trajectory optimization for an autonomous UAV-mounted base station that provides communication services to ground users with the aid of landing spots (LSs). Recently, the concept of LSs was introduced to alleviate the problem of short mission durations arising from the limited on-board battery budget of the UAV, which severely limits network performance. In this work, using Q-learning, a model-free reinforcement learning (RL) technique, we train a neural network (NN) to make movement decisions for the UAV that maximize the data collected from the ground users while minimizing power consumption by exploiting the landing spots. We show that the system intelligently integrates landing spots into the trajectory to extend flying time and is able to learn the topology of the network over several flying epochs without any explicit information about the environment.

Subfields: Aerospace Engineering, Computer Networks and Communications

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

1. Rui Zhang
2. Qingqing Wu
3. Yong Zeng
4. Shuowen Zhang
5. Merouane Debbah
6. Robert Schober
7. Jie Xu
8. Changsheng You

In Computer Networks and Communications

1. Rui Zhang
2. Qingqing Wu
3. Yong Zeng
4. Jie Xu
5. Walid Saad
6. Merouane Debbah
7. Medhi Bennis
8. Mohammad Mozaffari

Citations in the corpus

• Accessing From the Sky: A Tutorial on UAV Communications for 5G and Beyond (2019, background): “[177] H.”