Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments

Tao, Cancan; Liu, Bowen

doi:10.3390/drones8120771

Open AccessArticle

Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments

by

Cancan Tao

^*

and

Bowen Liu

School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China

^*

Author to whom correspondence should be addressed.

Drones 2024, 8(12), 771; https://doi.org/10.3390/drones8120771

Submission received: 25 October 2024 / Revised: 16 December 2024 / Accepted: 17 December 2024 / Published: 19 December 2024

(This article belongs to the Special Issue Advances in Civil Applications of Unmanned Aircraft Systems: 2nd Edition)

Download

Browse Figures

Versions Notes

Abstract

:

In order to improve the network performance of multi-unmanned ground vehicle (UGV) systems in urban environments, this article proposes a novel online autonomous motion-control method for the relay UAV. The problem is solved by jointly considering unknown RF channel parameters, unknown multi-agent mobility, the impact of the environments on channel characteristics, and the unavailable angle-of-arrival (AoA) information of the received signal, making the solution of the problem more practical and comprehensive. The method mainly consists of two parts: wireless channel parameter estimation and optimal relay position search. Considering that in practical applications, the radio frequency (RF) channel parameters in complex urban environments are difficult to obtain in advance and are constantly changing, an estimation algorithm based on Gaussian process learning is proposed for online evaluation of the wireless channel parameters near the current position of the UAV; for the optimal relay position search problem, in order to improve the real-time performance of the method, a line search algorithm and a general gradient-based algorithm are proposed, which are used for point-to-point communication and multi-node communication scenarios, respectively, reducing the two-dimensional search to a one-dimensional search, and the stability proof and convergence conditions of the algorithm are given. Comparative experiments and simulation results under different scenarios show that the proposed motion-control method can drive the UAV to reach or track the optimal relay position and improve the network performance, while demonstrating that it is beneficial to consider the impact of the environments on the channel characteristics.

Keywords:

unmanned aerial vehicle; communication relay; channel estimation; motion control; Gaussian process; gradient method; wireless networks

1. Introduction

Compared with a single agent, a multi-agent system can collaboratively complete tasks more efficiently and economically. In the past few decades, systems composed of multi-agents have shown great advantages in both military and civilian fields by collaborating to learn and adapt in harsh and unknown environments to achieve common goals [1]. Communication and information exchange play a critical role in the success of tasks in multi-agent systems; however, the increase in distance makes it difficult for the agent in the system to meet these requirements [2].

Using communication relays between intelligent nodes is a possible solution [3], and UAVs are particularly suitable for this task. Traditional base stations are not flexible enough and have high costs. Due to their small size, low cost, and flexibility, UAVs are showing a diversified development trend in the military field and are gradually playing a more important role in the field of communication relay [4]. Compared with ground and satellite relays, UAVs have better relay performance [5]. In addition, this kind of instant communication relay without human intervention can be easily deployed; for example, it can be quickly deployed in the event of communication link failures, and it has the advantages of high adaptability and strong survivability, especially in harsh environments [6].

Dixon et al. [7] proposed an adaptive planning framework based on extremum-seeking control to drive a UAV to a position that improves the chain capacity in point-to-point communication. Its advantage is that even in the presence of unknown interference sources, the performance output can be utilized to drive the UAV to the optimal relay point searched in real time, and only the node position and the sampled objective function value need to be obtained. Yaliniz et al. [8] focused on solving the deployment problem of using UAVs as aerial relays to assist ground cellular networks. They derived a closed-form solution based on a mixed-integer nonlinear optimization method and also considered the effect of UAV altitude on relay-deployment performance when maximizing network performance. Choi et al. [9] used energy efficiency as a metric and maximized the relay energy efficiency through optimizing the UAV speed and load, thereby improving the communication efficiency of a single relay UAV connecting two fixed ground units. However, in these works, user nodes are assumed to be stationary.

Others focus on using the UAV to enhance communication among mobile nodes. Huang et al. [10] aimed to use UAVs to assist in IoT data collection, introduced aerial collaborative relay transmission between UAVs, and proposed an AOI-sensitive data-collection scheme to iteratively optimize the UAV flight paths, solving the problem that UAVs in edge areas need to fly long distances to send data to the base station. Kim et al. [11] proposed a relay UAV motion-planning method based on NMPC and a minimum spanning tree in a dynamic environment, aiming to enhance the communication among a fleet of naval ships. Based on Kim’s work, Lun et al. [12] focused on using solar-powered UAVs as communication relays to assist communication among a fleet of ships. Taking both communication connectivity and energy absorption into consideration, they provided the optimal relay path of the SUV, which has a longer flight endurance. Jian et al. [13] proposed an optimization method for simultaneously designing beamforming (BF) and flight trajectory to improve the communication performance between moving users and ground stations using the UAV. The BF weight vectors and the heading angle of the UAV were solved, and experimental results showed that the flight trajectory generated by the proposed method was close to optimal. Although these works have been proven to be suitable for supporting communication for moving users, they all adopted relatively simple communication channel models. These models are actually over-simplified, which will lead to a decrease in the final communication performance [14] and are difficult to use in complex environments. Therefore, it is necessary to use more realistic wireless communication models in research.

Chamseddine et al. [15] proposed a control law to control the UAV to fly to the optimal point without knowing the user’s location. This method requires simultaneous measurement of the power and AoA for each ground user. However, due to the diversity of ground users and the different communication devices they carry, it is quite difficult to obtain these two types of information for each ground user at the same time [16]. Hyondong et al. [17] proposed a communication-aware motion-planning method based on NMPC (Nonlinear Model Predictive Control). The main idea is to maintain the LOS (Line of Sight) channel between the relay and the user according to the communication feasible area that changes dynamically with the user’s movement. Yin et al. [18] addressed the problem of using relays to enhance data transmission between remote mission UAVs and the ground base station. Considering the signal-propagation characteristics, antenna characteristics, and environmental characteristics, they proposed an algorithm that combines mixed-integer nonlinear programming and the consensus-based bundle algorithm to solve the problem, achieving maximum communication performance with a minimum number of relays. Although these research works consider moving nodes and more realistic channel models, the RF channel parameters of the task environment are still assumed known. However, it is quite difficult to acquire the RF channel parameters of the entire task environment in advance, as wireless channel parameters are variable and influenced by various factors such as user type, obstacles, weather, etc.

Wu et al. [19] proposed a least squares-based algorithm to predict the RF channel parameters of the task environment for online autonomous motion control of relay UAVs in unknown channels, achieving the goal of enhancing the communication quality of the airborne multi-agent system using a single UAV. However, this work assumes that the aerial environment in which the agent operates is single and simple, without obstacles or other interference, making it difficult to directly apply to other relay tasks with slightly more complex environments. Kim et al. [20] proposed a novel relay UAV-positioning method with channel prediction to enhance the communication quality of multiple moving users in uncertain environments and sought the optimal relay position through an optimization method based on Social Learning Particle Swarm Optimization (SL-PSO). However, this method is time-consuming. Ladosz et al. [21] considered that wireless channel parameters may change during the task and suggested a neural network-based algorithm to predict the channel parameters, and they planned the relay flight trajectory through a rolling-horizon optimization algorithm. However, this channel-prediction method requires the simultaneous collection of communication-strength data and angle-of-arrival information of the signal.

In addition, when conducting online autonomous motion control of the relay UAV, if the impact of different environment types and environmental changes on the relay communication performance can be taken into account, the communication quality of the entire network can be further improved.

In this context, this article proposes a novel relay UAV motion-control method to drive a single UAV to the desired position while considering the UAV’s kinematic constraints to achieve optimal communication network performance. The main contributions are as follows: (1) Jointly consider unknown multi-user mobility, unknown RF channel parameters, environmental complexity, and unavailable angle-of-arrival information of the received signals. In addition, when optimizing network performance, the impact of environmental changes on channel characteristics and relay performance is considered. (2) An algorithm based on Gaussian process (GP) learning is proposed to estimate the unknown channel between the UAV and the ground node. (3) To meet the real-time requirements when searching for the UAV’s optimal relay position, two algorithms are proposed to reduce the search space. Specifically, for point-to-point communication, we propose a line search algorithm, and its effectiveness and stability are given and proved; for multi-node communication, we propose a general gradient-based algorithm to replace the global search.

The rest of this article is organized as follows: Section 1 presents the various models used in this article and the mathematical formulation of the UAV relay problem; Section 2 provides a detailed analysis of using the Gaussian process learning-based algorithm to estimate the unknown channel parameters between the UAV and the ground node; Section 3 proposes low-complexity solutions searching the optimal UAV relay position under two relay scenarios; Section 4 simulates the proposed relay motion-control algorithm in different application scenarios and conducts various comparisons and analyses. Finally, Section 5 summarizes the work of this article.

2. System Model and Problem Formulation

2.1. Air-to-Ground Relay Scenario in Urban Environments

As illustrated in Figure 1, multiple unmanned ground vehicles (UGVs) perform tasks (such as reconnaissance or search tasks) in area

Ω

\in

R^{2}

. Due to the influence of surrounding buildings, trees, and terrain, the communication conditions between UGVs are poor. To improve the communication between UGVs, UAVs equipped with higher-performance communication equipment act as relays over the city. In Figure 1, blue rectangular prisms of different heights represent buildings in the city, red solid lines represent the communication links between relay UAVs and UGVs, cyan solid lines represent the flight trajectories of UAVs, and black dashed lines represent the motion trajectories of UGVs.

Due to the complex and ever-changing urban environments in which UGVs are located, it is difficult to fully acquire the RF channel parameters of the entire task area before the relay task is executed. Therefore, the wireless channel parameters of the environments are unknown in advance. The UAV needs to estimate the wireless channel parameters near the current position in real time based on the online measured information and then calculate the optimal relay position and drive the UAV to fly to the optimal point, thereby providing the best possible communication link quality for the UGVs that are performing tasks.

2.2. UAV Kinematic Model

Assuming that the UAV is a fixed-wing aircraft and maintains a specific cruising altitude during the relay process, the control variables are the turning rate and acceleration. Let

p_{u}

=

[x_{u}

,

y_{u}]^{T}

represent the position vector, and the velocity vector is

[{\dot{x}}_{u}

,

{\dot{y}}_{u}]^{T}

; then, its kinematic model can be expressed as [22]

\{\begin{cases} {\dot{x}}_{u} (t) = v_{u} (t) \cos ψ_{u} (t) \\ {\dot{y}}_{u} (t) = v_{u} (t) \sin ψ_{u} (t) \\ {\dot{v}}_{u} (t) = a_{u} (t) \\ {\dot{ψ}}_{u} (t) = \frac{v_{u} (t)}{r_{u} (t)} = v_{u} (t) c_{u} (t) = ω_{u} (t) \end{cases}

(1)

where

ψ_{u}

is the heading angle,

ψ_{u}

\in

[0, 2 π)

;

v_{u}

is the flight speed,

v_{u}

=

‖v_{u}‖

=

‖({\dot{x}}_{u}, {\dot{y}}_{u})‖

;

r_{u}

is the turning radius, and

r_{u}

=

\frac{1}{c_{u}}

;

a_{u}

is the acceleration;

ω_{u}

is the turning rate, satisfying

|ω_{u}|

\leq

ω_{u, \max}

. Due to the limitation of the aircraft’s operating performance, the maximum turning rate

ω_{u, \max}

is constrained by the maximum roll angle

ψ_{u, \max}

, that is,

ω_{u, \max}

=

\frac{g \tan (ψ_{u, \max})}{v_{u}}

, where

g

is the acceleration constant under gravity.

This model assumes that the inner-loop control system of the UAV can quickly reach the required acceleration and turning rate, thus ignoring jerk and rolling inertia, and ignoring the influence of wind on the aircraft motion. In addition, this article assumes that the UAV maintains a specific speed during the relay process, the acceleration is 0, and the flight control variable is only the turning rate of the UAV.

2.3. Motion Model of the UGV

Although the Random Direction (RD) model and the Random Waypoint (RWP) model have been widely used in previous MANET research, the smooth turning (ST) motion model proposed by Wan et al. [23] has stronger generality and practicality, and it has begun to be used in the latest MANET-related research. Its two-dimensional mathematical model is as follows:

\{\begin{cases} a_{t} (t) = \frac{d v_{g}}{d t} = 0 \\ a_{n} (t) = \frac{v_{g}^{2}}{r (T_{i})} \\ {\dot{ψ}}_{g} (t) = - ω_{g} (t) = - \frac{v_{g}}{r (T_{i})} \\ {\dot{x}}_{g} (t) = v_{g, x} (t) = v_{g} \cos (ψ_{g} (t)) \\ {\dot{y}}_{g} (t) = v_{g, y} (t) = v_{g} \sin (ψ_{g} (t)) \\ τ (T_{i}) = T_{i + 1} - T_{i} \end{cases} T_{i} \leq t < T_{i + 1}

(2)

where

x_{g} (t)

and

y_{g} (t)

denote the coordinates of the node in the

x

and

y

direction at time

t

, respectively, i.e.,

p_{g}

=

[x_{g} (t)

,

y_{g} (t)]^{T}

;

v_{g, x} (t)

and

v_{g, y} (t)

respectively denote the velocity of the node in the

x

and

y

direction, that is,

v_{g}

=

[v_{g, x} (t)

,

v_{g, y} (t)]^{T}

;

ω_{g} (t)

represents the turning rate of the node;

ψ_{g} (t)

represents the heading angle;

a_{t} (t)

represents the vertical acceleration;

a_{n} (t)

represents the horizontal acceleration;

r (T_{i})

represents the turning radius selected at the

T_{i}

decision time; and

τ (T_{i})

is the interval time.

2.4. Future Position Prediction Based on Kalman Filter

Due to the inability of the UAV to obtain the location of the UGV at the future moment, this paper uses the current position of the UGV obtained and represents the position change of the UGV through an Auto-Regressive (AR) motion model, and it then predicts the position of the node at the next moment based on the Kalman Filter (KF).

Let

x_{i} (k)

=

[x_{i, k}

,

{\dot{x}}_{i, k}

,

{\ddot{x}}_{i, k}

,

y_{i, k}

,

{\dot{y}}_{i, k}

,

{\ddot{y}}_{i, k}]^{T}

represent the state of the UGV

n_{i}

at time

k

.

x_{i, k}

,

{\dot{x}}_{i, k}

,

{\ddot{x}}_{i, k}

and

y_{i, k}

,

{\dot{y}}_{i, k}

,

{\ddot{y}}_{i, k}

respectively represent the coordinates, velocity, and acceleration of the UGV

n_{i}

in the corresponding direction. Then, the state-transition equation of the UGV from time

k

to time

k + 1

can be expressed as follows:

x_{i} (k + 1) = F x_{i} (k) + η_{i} (k)

(3)

F = (\begin{matrix} 1 & T_{s} & q_{1} & 0 & 0 & 0 \\ 0 & 1 & q_{2} & 0 & 0 & 0 \\ 0 & 0 & e^{- α T_{s}} & 0 & 0 & 0 \\ 0 & 0 & 0 & 1 & T_{s} & q_{1} \\ 0 & 0 & 0 & 0 & 1 & q_{2} \\ 0 & 0 & 0 & 0 & 0 & e^{- α T_{s}} \end{matrix})

(4)

q_{1} = (e^{- α T_{s}} + α T_{s} - 1) / α^{2}

(5)

q_{2} = (1 - e^{- α T_{s}}) / α

(6)

where

F

denotes the transition matrix, and

η_{i} (k)

denotes the process noise, represented by a Gaussian variable with a mean of 0 and a covariance matrix

Q_{i} (k)

=

σ_{η}^{2} I_{6}

, where

I_{6}

is a

6 \times 6

unit matrix;

T_{s}

is the time interval from time

k

to time

k + 1

; and

α

is a parameter used to simulate different types of maneuvering targets. When the speed is slow,

α

is small, and when the speed is fast,

α

is large. The noisy observation of the position of the UGV

n_{i}

at time

k

is [24]

p_{i} (k) = H x_{i} (k) + v_{i} (k)

(7)

H = (\begin{matrix} 1 & 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 1 & 0 & 0 \end{matrix})

(8)

where

p_{i} (k)

is the coordinate position of the UGV

n_{i}

observed at time

k

;

H

denotes the observation matrix; and

v_{i} (k)

denotes the observation noise, represented by a Gaussian variable with a mean of 0 and a covariance matrix

R_{i} (k)

=

σ_{v}^{2} I_{2}

, where

I_{2}

denotes a

2 \times 2

unit matrix. Therefore, the position filtering and prediction process of the UGV

n_{i}

can be given as

{\hat{x}}_{i, k | k - 1} = F {\hat{x}}_{i, k - 1}

and

L_{i, k | k - 1} = F L_{i, k - 1} F^{T} + Q_{i, k - 1}

, where subscript

i

represents the

i

-th ground node;

{\hat{x}}_{i, k - 1}

is the estimated state value of ground node i at time

k - 1

;

{\hat{x}}_{i, k | k - 1}

is the estimated state value of ground node

i

at time

k

based on the state value at time

k - 1

. Kalman gain can be expressed as

K_{i, k} = L_{i, k | k - 1} T^{T} {(T L_{i, k | k - 1} T^{T} + R_{i, k})}^{- 1}

. State measurement and covariance matrix can be given as

{\hat{x}}_{i, k} = {\hat{x}}_{i, k | k - 1} + K_{i, k} (p_{i, k} - T {\hat{x}}_{i, k | k - 1})

and

L_{i, k} = (I_{4} - K_{i, k} T) L_{i, k | k - 1}

. The corresponding derivation process can be found in [24].

2.5. Problem Formulation of Optimal Relay Position Search

This article drives the UAV to the desired relay position by controlling its motion, in order to achieve optimal network performance. Let

N

=

{n_{1}

,

n_{2}

, …,

n_{N}}

be the set of UGVs, where

N

is the number of UGVs. Let

p_{i}

=

[x_{i}

,

y_{i}]

,

i =

1

,

2

, …,

N

represent the position of UGV

n_{i}

, and, assuming that the flight altitude and speed of the UAV remain constant (which is reasonable for many UAV relay tasks), then the flight control variable of the UAV is only the turning rate

{\dot{ψ}}_{u}

. The goal of relay motion control is to optimize the objective function by finding the optimal value for the turning rate of the UAV. The problem model is established as follows:

{\dot{ψ}}_{u}^{*} = \underset{|{\dot{ψ}}_{u}| \leq ω_{u, \max}}{\arg \max J ({\dot{ψ}}_{u})}

(9)

where

J ({\dot{ψ}}_{u})

represents the performance index function.

This article develops a decision system by determining the optimal UAV location, then uses the guidance law to drive the UAV to this location. We focus our research on the former issue and formulate it as follows:

p_{u}^{*} = \underset{p_{u} \in Ω}{\arg \max J (p_{u})}

(10)

where

p_{u}^{*}

denotes the optimal relay position.

2.6. Motion Control Framework for Relay UAV

This article aims to solve the issue of online autonomous motion control of relay UAVs in the case of supporting moving nodes, unknown RF channel parameters, and only RSS information. To solve the issue of inaccurate position and predicted positions of moving nodes, a method based on Kalman Filtering is established. To cope with the situation where RF channel parameters are unknown and only RSS and node position information are available, a channel parameter estimation method based on online collectible data is established, and a novel simplified optimal UAV position-calculation method is proposed. Finally, the optimal position is input to the UAV guidance flight module, which outputs the required turning rate to drive the UAV to fly to the optimal relay point, thereby optimizing the network performance. The corresponding method framework of this article is shown in Figure 2.

3. Online Estimation of Wireless Channel Parameters

In the air-to-ground relay system, the UGVs perform tasks (such as reconnaissance or search) in the environmental area, while the UAV dynamically adjusts its positions according to the movements of the UGVs and changes in the RF signal environment, so as to continuously provide the best possible communication performance for the UGVs.

This problem mainly involves two aspects, namely, communication and motion control, which are closely related and coupled with each other because the quality of communication determines the UAV’s motion direction and position of the next moment, and the motion of nodes will influence the communication performance of the entire network.

3.1. Model of the Received Signal

Previous studies on UAV relay communication have mostly adopted relatively simple channel models, resulting in reduced communication performance. This paper studies the air-to-ground relay system under urban environments, where the RF signal environment is more complex. Therefore, it is necessary to adopt a more realistic communication model.

Assume that the UAV

u

and

N

UGVs

n_{i}

\in

N

=

{

n_{1}

,

n_{2}

, …,

n_{N}

}

in the task area

Ω

are equipped with omnidirectional antennas. As shown in Figure 3, air-to-ground signal propagation is divided into two parts: free space and low-altitude environment. In the low-altitude environment, due to the existence of buildings, trees, and other obstacles, the signal undergoes shadowing and scattering phenomena, thereby introducing extra loss in the air-to-ground transmission link. The channel fading between the relay UAV and the UGV can be modeled as [25,26]

P_{r, i} = P_{t, i} - L_{i} - Ψ_{i}

(11)

L_{i} = 10 λ \log_{10} (\frac{4 π f_{c} d_{i}}{c})

(12)

In Equation (16),

P_{r, i}

represents the power received by the UAV

u

from the

i

-th UGV

n_{i}

, in dBm;

P_{t, i}

represents the signal transmission power of

n_{i}

, in dBm;

L_{i}

represents the path fading loss between

u

and

n_{i}

, in dB; and

Ψ_{i}

represents the shadow fading loss between

u

and

n_{i}

, in dB.

In Equation (17),

d_{i}

represents the distance between

u

and

n_{i}

;

f_{c}

represents the carrier frequency of the radio wave;

c

represents the speed of the light wave; and

λ

represents the path attenuation factor, generally ranging from 2 to 6.

In air-to-ground communication, the density of buildings has a great influence on the channel characteristics. This is because their distribution characteristics affect the probability of the LoS (Line of Sight) component. Due to the movement of UGVs, this probability is prone to sudden changes, such as if the LoS between the UGV and the relay UAV is suddenly blocked by a high building. Obviously, the simple distance channel model (DCM) [27] and the statistical distribution-based probabilistic channel model (SDPCM) [28] cannot reflect the impact of the above factors. In addition, the flight altitude of the UAV affects the elevation angle of the LoS between the UGV and the UAV, which in turn affects the LoS probability. The DCM and the SDPCM are also difficult to reflect the impact of altitude on channel characteristics.

To calculate the expected value of shadow fading between the relay UAV and the UGV with an elevation angle of

θ

, the following equation can be applied to obtain [25,26]:

Ψ_{i} = \sum_{ε} η_{ε} P (ε, θ)

(13)

where

P (ε, θ)

is the probability of the

ε

-th signal propagation group with an elevation angle of

θ

, and

η_{ε}

denotes the shadow fading loss value of the

ε

-th propagation group. This study follows the assumption of two propagation groups, strictly corresponding to the LoS propagation condition and the NLoS (None Line of Sight) propagation condition, that is, when

ε \in {LoS, NLoS}

, then [29]

Ψ = P (LoS, θ) η_{LoS} + (1 - P (LoS, θ)) η_{NLoS}

(14)

where

η_{LoS}

and

η_{NLoS}

denote the additional path loss of the LoS link and the NLoS link, respectively.

The LoS probability is affected by the environment and is a function of the transmitting antenna height

h_{TX}

and the receiving antenna height

h_{RX}

. It is also related to the statistical parameters of the environment. According to the recommendations document of the International Telecommunication Union, it can be formulated as follows [30]:

\begin{array}{l} P (LoS) = \\ \prod_{n = 0}^{m} [1 - \exp (- \frac{{[h_{TX} - \frac{(n + \frac{1}{2}) (h_{TX} - h_{RX})}{m + 1}]}^{2}}{2 γ^{2}})] \end{array}

(15)

m = floor (r \sqrt{α β} - 1)

(16)

where

α

represents the percentage of the building land to the total land;

β

represents the number of buildings per square kilometer;

γ

is the proportional parameter describing the building height distribution; and

r

denotes the ground distance between the transmitting antenna and the receiving antenna, as illustrated in Figure 3. Since the receiving antenna height

h_{RX}

is much lower than the height of the building and the relay UAV, it can be ignored. Therefore, the ground distance

r

between the relay UAV and the UGV is calculated as follows:

r = \frac{h}{\tan (θ)}

(17)

where

h

denotes the UAV’s altitude. By fitting the channel attenuation of Equation (20) in different environments, it can be found that Equation (20) can be expressed by the Sigmoid function (S-Curve), as follows [25]:

P (LoS, θ) = \frac{1}{1 + a \exp (- b (θ - a))}

(18)

θ = \frac{180}{π} \times \arctan (\frac{h}{r})

(19)

where

a

and

b

are S-Curve parameters, and

θ

denotes the elevation angle, as shown in Figure 3.

Since the communication model used in this article takes into account the impact of the environment on the LoS signal component, that is, simultaneously considering the probability of the occurrence of LoS channels and NLoS channels, it will be referred to as the average gain-based probability channel model (AGPCM) in the following.

3.2. Channel Estimation Based on Gaussian Process

In practical application, it is difficult or even impractical to acquire the RF channel parameters of the entire task area before the relay task due to the dynamics of the network, the differences in the nodes, the changes in the RF distribution in the task area, etc. Gaussian process (GP) is mainly utilized to infer or predict the function value on finite test points based on observed data. Therefore, this article proposes a GP-based learning algorithm that utilizes online collected RSS data to learn the impact of shadow fading and combines it with the known parts of the communication model.

From Equation (16), it can be seen that the received power

P_{r, i}

is related to the signal transmission power

P_{t, i}

, path fading

L_{i}

, and shadow fading

Ψ

. Since

P_{t, i}

is a constant, and the path fading

L_{i}

is caused by the continuous consumption of the transmitted signal as the propagation distance increases, and from Equation (17), it can be seen that

L_{i}

is constant at a specific location, so only the shadow fading

Ψ

needs to be estimated.

Shadow fading

Ψ

is caused by obstacles between the transmitter and receiver. When modeling shadow fading in an environment with incomplete information, it is generally assumed that the channel gain follows a Gaussian distribution with variance

σ^{2}

, that is [31],

Ψ \sim N (μ, σ^{2})

(20)

where

μ

represents the fading mean, and

σ^{2}

represents the fading variance.

GP is a random process defined on a continuous domain. For this article, the continuous domain is a small spatial domain around the current position of the UAV, denoted as

δ

. Let

t_{k}

denote the decision moment; in a given environment, the wireless channel is sparsely sampled at the node positions

P_{i}

=

{p_{i}^{1}

,

p_{i}^{2}

, …,

p_{i}^{κ}}

\subset

Ω

,

i

=

1

,

2

,...,

N

during time

[t_{k - 1}

,

t_{k})

, where

κ

is the number of samples. Those channel measurements can be performed by the UAV along its trajectory

P_{u}

=

{p_{u}^{1}

,

p_{u}^{2}

, …,

p_{u}^{κ}}

\subset

Ω

. Since the UAV maintains a constant altitude when performing the relay task, any position

p

in the continuous domain

δ

can be regarded as a two-dimensional vector. For the convenience of the subsequent process,

p

is re-recorded as

x

\in

R^{2}

, then the

κ

input features constitute

X

=

[x_{1}

,

x_{2}

, …,

x_{κ}]^{T}

,

X

\in

R^{κ \times 2}

, and the corresponding target value

y

=

[y_{1}

,

y_{2}

, …,

y_{κ}]^{T}

,

y

\in

R^{κ \times 1}

,

y

represents the vector of received signal power measurement, so the training set can be formulated as

D

=

{(X

,

y)}

. Considering that the actual output contains noise, the Gaussian process regression is modeled as follows:

\{\begin{cases} y_{i} = f (x_{i}) + ε i = 1, 2, \dots, κ \\ ε \sim N (0, {\bar{σ}}_{n}^{2}) \end{cases}

(21)

where

ε

is Gaussian white noise with a mean of 0 and a variance of

{\bar{σ}}_{n}^{2}

, and

f (\cdot)

represents an implicit function independent of the noise. Assuming that the function value

f (x_{1})

,

f (x_{2})

, …,

f (x_{κ})

forms a joint Gaussian distribution after the input feature is mapped by function

f

, since the noise

ε

and the implicit function

f

are independent of each other, the output

y_{i}

also obeys a Gaussian distribution, and the set of its finite observations’ joint distributions can form a GP, that is [31],

y \sim G P (m (x), k (x ’, x))

(22)

m (x) = E [f (x)]

(23)

k (x ’, x) = E [(f (x) - m (x)) (f (x ’) - m (x ’))]

(24)

where

m (x)

denotes the mean function of the implicit function

f (x)

, and

k (x ’, x)

denotes the covariance function of the implicit function

f (x)

. Since the space of the urban environment where the UAV performs the relay task is irregular, the radial basis function (RBF) can realize nonlinear mapping, and the hyperparameters required for training are greatly reduced compared to the polynomial kernel function, RBF is used in this paper to characterize the covariance function [32]:

k (x ’, x) = σ_{f}^{2} \exp [- \frac{1}{2} {(x - x ’)}^{T} M_{D} (x - x ’)]

(25)

where

M_{D}

=

diag (l^{2})

is a symmetric matrix about the hyperparameter

l

, where

l

is the horizontal factor parameter; the hyperparameter

σ_{f}^{2}

is the vertical scale factor that regulates the variation of the covariance function. Then, define the mean function as:

m (x) = c

(26)

where

c

denotes the hyperparameter to be optimized. Let

θ

=

[l

,

σ_{f}^{2}

,

c]

be the hyperparameter set, and the optimal value needs to be obtained through training and learning. Under the condition that the channel fading in each sampling satisfies independence, the fitness of the GP model to the training set

D

can be evaluated by the following marginal likelihood conditioned on the hyperparameter set

θ

:

\begin{array}{l} L (θ) = \log (y | X, θ) = - \frac{1}{2} y^{T} {(K_{X X} + σ_{n}^{2} I)}^{- 1} y \\ - \frac{1}{2} \log |K_{X X} + σ_{n}^{2} I| - \frac{κ}{2} \log (2 π) \end{array}

(27)

Therefore, the hyperparameter set

θ

of the GP model can be obtained through maximizing the marginal likelihood

L (θ)

, that is [33],

θ^{*} = \underset{θ}{\arg \max} (L (θ))

(28)

According to the Bayesian principle, the GP model establishes a priori function in the training set

D

and converts it into a posterior distribution on the test data

x^{*}

. Therefore, the prediction result

y^{*}

obtained from the test data input forms a joint Gaussian distribution with the target value

y

of the training set data, that is,

[\begin{array}{l} y \\ y^{*} \end{array}] \sim N ([\begin{array}{l} μ (X) \\ μ (x^{*}) \end{array}], [\begin{array}{l} K_{X X} + σ_{n}^{2} I & K_{X x^{*}} \\ K_{x^{*} X} & K_{x^{*} x^{*}} \end{array}])

(29)

where

K_{X X}

represents the autocovariance matrix of the input features of the training set;

K_{x^{*} x^{*}}

represents the autocovariance matrix of the input features of the test set; and

K_{X x^{*}}

represents the covariance matrix between the input features of the training set data and the test set data. For

x^{*}

, the prediction result based on the GP model is as follows:

y^{*} | X, y \sim N (μ_{f | X, y} (x^{*}), σ_{f | X, y}^{2} (x^{*}))

(30)

μ (x^{*}) = K_{x^{*} X} {(K_{X X} + σ_{n}^{2} I)}^{- 1} (y - μ (X)) + μ (x^{*})

(31)

σ^{2} (x^{*}) = K_{x^{*} x^{*}} - K_{x^{*} X} {(K_{X X} + σ_{n}^{2} I)}^{- 1} K_{x^{*} X}

(32)

where

μ (x^{*})

denotes the mean of

y^{*}

, and

σ^{2} (x^{*})

denotes the variance of

y^{*}

. The optimal value of the hyperparameters of the GP model is solved by Equation (33), and then, the mean and variance of the predicted output results are obtained using Equations (36) and (37), which are the mean and variance of the shadow fading at any position

x^{*}

\in

δ

near the current position of the UAV.

It should be pointed out that since both the UAV and the UGVs are moving, the RF distribution characteristics are actually changing dynamically. Therefore, the wireless channel parameter-estimation method proposed in this article can only estimate the channel characteristics near the UAV and cannot estimate the channel characteristics of the entire task area.

4. Searching for the Optimal Relay Position

This section presents and analyzes the adaptive optimal relay position search algorithm, which aims to give the optimal relay point, including point-to-point communication and multi-node communication.

4.1. Point-to-Point Communication

In point-to-point communication, UAVs play the role of forwarding information between two nodes that cannot communicate directly (such as a control station and a remote task node), thereby realizing indirect information exchange between the two. Due to the weaker communication capability of the ground node compared to the relay UAV, the performance bottleneck of the link lies in the uplink channel from the ground node to the relay UAV. Therefore, in point-to-point communication, the optimization of UAV position can be transformed into the following form:

p_{u}^{*} = \arg \max_{p_{u} \in Ω} \min {S_{p_{1}, p_{u}}, S_{p_{2}, p_{u}}}, p_{1}, p_{2} \in N

(33)

where

S_{p_{i}, p_{u}}

represents the strength of the wireless signal sent by the node

n_{i}

at position

p_{i}

and received by the relay UAV

u

at position

p_{u}

, and

J

=

\min

{S_{p_{1}, p_{u}},

S_{p_{2}, p_{u}}}

represents the communication index function under point-to-point communication, which is constrained by the link with the worst power. Moreover, the larger the value of

J

, the better the network performance.

The necessary condition for the objective function

J = \min {S_{p_{1}, p_{u}}, S_{p_{2}, p_{u}}}

in Equation (38) to achieve the maximum value is that

p_{u}^{*}

satisfies the following equation:

\nabla J (p_{u}^{*}) = \frac{\partial J}{\partial p_{u}} |_{p_{u} = p_{u}^{*}} = 0

(34)

In Equation (38),

\min (\cdot)

indicates that the objective function

J

is non-smooth and needs segmented differentiation according to the values of

S_{p_{1}, p_{u}}

and

S_{p_{2}, p_{u}}

, as follows:

\nabla J = \{\begin{cases} \nabla S_{p_{1}, p_{u}}, if S_{p_{1}, p_{u}} < S_{p_{2}, p_{u}} \\ \nabla S_{p_{2}, p_{u}}, if S_{p_{1}, p_{u}} > S_{p_{2}, p_{u}} \\ Other, if S_{p_{1}, p_{u}} = S_{p_{2}, p_{u}} \end{cases}

(35)

Theorem 1.

Solving

p_{u}^{*}

is equivalent to finding

p_{u}

that satisfies both of the following conditions simultaneously: (1)

S_{p_{1}, p_{u}}

=

S_{p_{2}, p_{u}}

; (2)

p_{u}

=

p_{1}

+

α

(p_{2}

-

p_{1})

, where

0

<

α

<

1

.

Proof.

Condition (2) indicates that the optimal relay position

p_{u}^{*}

must be on the line segment

[p_{1}

,

p_{2}]

bounded by the two point-to-point node positions

p_{1}

and

p_{2}

. The proof process is divided into two aspects. □

The sufficiency proof of the theorem states that if

p

=

p^{*}

, then

S_{1} (p)

=

S_{2} (p)

and

p

=

p_{1}

+

α

(p_{2}

-

p_{1})

.

First, we assume that

S_{1} (p)

>

S_{2} (p)

. From Equation (40), we know that

\nabla J

=

\nabla S_{2} (p)

, then

\nabla S_{2} (p)

=

0

, the condition for

\nabla S_{2} (p)

=

0

is

d_{2}

=

0

(

d_{2}

represents the Euclidean distance between

p_{2}

and

p

). However,

S_{i} (p)

is inversely proportional to the distance

d_{i}

, that is,

S_{1} (p)

>

S_{2} (p)

means that the distance

d_{1}

<

d_{2}

, so

d_{1}

<

0

, which obviously does not conform to the actual situation, and the assumption is not valid. Similarly,

S_{1} (p)

<

S_{2} (p)

. Therefore,

S_{1} (p)

=

S_{2} (p)

.

Next, we assume

p_{u}^{*}

\notin

[p_{1}, p_{2}]

. Obviously, there is a point

p ’

\in

[p_{1}, p_{2}]

that satisfies

S_{p_{1}, p ’}

=

S_{p_{2}, p ’}

, while

p ’

is not the optimal relay point. Therefore,

S_{p_{1}, p}

=

S_{p_{2}, p}

\geq

S_{p_{1}, p ’}

=

S_{p_{2}, p ’}

, so

d_{p_{1}, p}

\leq

d_{p_{1}, p ’}

and

d_{p_{2}, p}

\leq

d_{p_{2}, p ’}

, and then

d_{p_{1}, p}

+

d_{p_{2}, p}

\leq

d_{p_{1}, p ’}

+

d_{p_{2}, p ’}

. According to the triangle’s characteristic that the sum of the lengths of two sides must be greater than the length of the third side, this does not conform to the actual situation, that is, the assumption is not valid. Therefore, there must be

p_{u}^{*}

\in

[p_{1}, p_{2}]

.

In summary, the sufficiency of the theorem has been proven. The next step is to prove the necessity of the theorem, that is, if

S_{p_{1}, p_{u}}

=

S_{p_{2}, p_{u}}

and

p_{u}

\in

[p_{1}, p_{2}]

, then

p_{u}

=

p_{u}^{*}

.

We assume that there is a point

p ’

that satisfies

S_{p_{1}, p ’}

=

S_{p_{2}, p ’}

and

p ’

\in

[p_{1}, p_{2}]

, but

p ’

is not the optimal UAV point. Because

p_{u}^{*}

is the optimal UAV point,

S_{p_{1}, p_{u}^{*}}

=

S_{p_{2}, p_{u}^{*}}

>

S_{p_{1}, p ’}

=

S_{p_{2}, p ’}

, and therefore,

d_{p_{1}, p_{u}^{*}}

<

d_{p_{1}, p ’}

. Also, the value of

d_{p_{1}, p_{2}}

is constant,

d_{p_{2}, p_{u}^{*}}

>

d_{p_{2}, p ’}

, resulting in

S_{p_{2}, p_{u}^{*}}

<

S_{p_{2}, p ’}

. This is contrary to the assumption that

S_{p_{2}, p_{u}^{*}}

>

S_{p_{2}, p ’}

has been derived. Therefore, the assumption does not hold, that is,

p ’

=

p_{u}^{*}

must be true, and the proof of Theorem 1 ends.

In Theorem 1,

p_{u}^{*}

is only related to

α

. Therefore, the line search algorithm is able to be used to reduce the search space required to find the optimal UAV point under point-to-point communication.

Considering the possible situation, the relay UAV may still be unable to track changes in the optimal relay position point over time. Therefore, it is necessary to study the convergence conditions of this method:

Theorem 2.

When the speed of the UAV is greater than the maximum speed of the UGV, that is,

v_{u}

>

\max (v_{1}, v_{2})

, it can ensure that the UAV will converge to the optimal relay point.

Proof.

Let the changing speed of the optimal relay position point be

v_{p}^{*}

. If the UAV can converge to

p^{*}

, the constraint

v

>

v_{p}^{*}

must be met. According to the conclusion

p^{*}

=

p_{1}

+

α

(p_{2}

-

p_{1})

in Theorem 1, taking the derivative yields

v^{*}

=

v_{1}

+

α

(v_{2}

-

v_{1})

, where

α

\in

(0, 1)

, and obviously

v

=

‖{\dot{p}}^{*}‖

<

\max

(

‖v_{1}‖

,

‖v_{2}‖

)

, if

v

>

\max

(v_{1}

,

v_{2})

, then there must be

v

>

‖v^{*}‖

,

‖v^{*}‖

is

‖{\dot{p}}^{*}‖

, and Theorem 2 is proved. □

Theorem 2 reveals that as long as the UAV’s speed is greater than the maximum speed of the UGV, the relay task can be guaranteed to be feasible.

4.2. Multi-Node Communication

For relay to support multi-node communication, each node in the ground system may need to utilize the relay-forwarding capability of the UAV to exchange information with other nodes, so the communication performance between all node pairs needs to be considered. The communication performance between nodes is usually limited by the uplink from the ground node to the relay, which contains multiple uplink channels with different transmission capabilities. Therefore, the objective function of the

\min (\cdot)

form in Section 3.1 is no longer suitable as a metric to evaluate the communication performance of a multi-node relay network. This article uses the following objective function to characterize the network performance of multi-node communication [34]:

p_{u}^{*} = \arg \min_{p_{u} \in Ω} \frac{1}{N} \sum_{i = 1}^{N} \frac{1}{S_{p_{i}, p_{u}}}, n_{i} \in N

(36)

where

\frac{1}{J} = \frac{1}{N} \sum_{i = 1}^{N} \frac{1}{S_{p_{i}, p_{u}}}

, the network performance J represents the average power of all channels, and the larger the value of J, the better the network performance.

First, we discuss a special case where the attenuation factors of each channel satisfy the condition

λ_{1} =

λ_{2} =

\dots =

λ_{N} =

2

. By solving Equation (39) and (41), we can obtain the following:

x_{u}^{*} = \frac{\sum \frac{1}{G_{i}} x_{i}}{\sum \frac{1}{G_{i}}}, y_{u}^{*} = \frac{\sum \frac{1}{G_{i}} y_{i}}{\sum \frac{1}{G_{i}}}

(37)

where

x_{u}^{*}

and

y_{u}^{*}

are the coordinates of the optimal relay point, that is,

p_{u}^{*}

=

(x_{u}^{*}, y_{u}^{*})

, and

G_{i}

denotes the communication channel gain between the relay UAV

u

and the UGV

n_{i}

.

However, in many practical applications, due to the diversity of nodes, the dynamics of the system, and changes in the environment, channel parameters do not meet the above conditions, that is, the assumption

λ_{1} =

λ_{2} =

\dots =

λ_{N} =

2

is not satisfied. Solving Equation (41) is a very challenging issue, and this paper proposes a new gradient-based method to solve this issue, and it has a relatively small computational cost.

For each node

n_{i}

,

i

=

1

,

2

, …,

N

in the ground multi-vehicle system, the power

S_{{\hat{p}}_{i}, p ’_{u} (β)}

emitted by the UGV

n_{i}

at

{\hat{p}}_{i}

and received by the relay UAV

u

at

p ’_{u} (β)

=

p_{u}

+

[R

\cos β

,

R

\sin β

]^{T}

,

0

\leq

β

<

2 π

can be estimated using the wireless channel estimation model in Section 2.2 (Equations (25)~(37)), where

{\hat{p}}_{i}

denotes the predicted position of the UGV

n_{i}

by the Kalman Filter,

p_{u}

represents the UAV’s current position, and

R

represents a constant distance from

p_{u}

. Therefore, the objective function

J

of the network performance in Equation (41) is updated as follows:

\frac{1}{J (β)} = \frac{1}{N} \sum_{i = 1}^{N} \frac{1}{S_{{\hat{p}}_{i}, p ’_{u} (β)}}, 0 \leq β < 2 π

(38)

The positive gradient direction

β^{*}

is the direction in which the objective function rises fastest. Therefore, according to Equation (43),

β^{*}

can be calculated by maximizing the objective function

J (β)

, that is,

β^{*} = \arg \max_{β \in [0, 2 π)} J (β)

(39)

After calculating the positive gradient direction

β^{*}

near the current position of the relay UAV, the unit direction vector of the optimal target position of the UAV at the next moment can be formulated as follows:

μ_{t_{k}} = (\cos β^{*}, \sin β^{*})

(40)

According to the basic principle of the gradient climbing method, the optimal target position for the next moment can be calculated from the current position

p_{u}

and the optimal unit direction vector

μ_{t_{k}}

, as follows:

p_{u, t_{k}}^{*} = p_{u} + γ \cdot μ_{t_{k}}

(41)

where

γ

is a predefined dimensionless quantity.

5. Simulation Results and Analysis

This section uses simulation experiments to verify and analyze the feasibility of the proposed online autonomous motion control method for relay UAV supporting UGVs’ communication in urban environments, as well as to compare algorithm performance. This experiment considers the scenario of UAV supporting point-to-point communication and multi-node communication for UGVs, and gradually shifts from discussing supporting stationary nodes to moving nodes and then to moving nodes in unknown channels.

This article compares with other methods found in the literature, and the literature used for comparison mainly includes two parts, namely, literature related to relay motion control based on different channel models and literature related to relay motion control based on different channel-prediction methods. First, this article compares the literature based on different channel models, namely, literature 26 and literature 27. The channel model used in literature 26 only considers the distance factor, without considering the transmission power and channel attenuation, while the channel model used in literature 27 simultaneously considers the effects of distance, transmission power, and channel attenuation. On the basis of considering these three influencing factors, this article further considers the influence of building height and distribution density in different urban areas on signal propagation. Therefore, the methods of literature 26 and 27 are selected for comparison. The difference in the relay implementation effect will be more obvious, thus reflecting the difference in the effects achieved by the relay motion-control methods based on different channel models. Then, this article compares relevant literature based on different channel-prediction methods, namely, literature 35 and literature 21, because they consider relay application scenarios similar to this article, namely, UAV relay in complex urban environments. At the same time, since different channel-prediction methods have requirements for their own application scenarios and may not be applicable to other relay scenarios, literature 35 and literature 21 are selected.

5.1. Simulation Parameters Setting

In the simulation, the motion of the UGV follows the smooth turning model [23]. The UAV is a fixed-wing aircraft and has kinematic constraints. The UAV can obtain the position information of the UGV but cannot obtain the instantaneous velocity (including size and direction) information of the UGV, nor can it obtain the future position information of the UGV. However, the Kalman Filter algorithm described in Section 2.4 is used for estimation. In the last experiment, the UAV does not know the wireless channel parameters in advance, but estimates them based on the channel-estimation model based on Gaussian process learning given in Section 2.2.

The environmental area is divided into four types [25], and the channel model parameters corresponding to each type of area are shown in Table 1, with the coverage range shown in Table 2.

In order to examine the impact of the environments on channel characteristics and the performance of motion-control algorithms based on different models, comparative experiments are conducted, including two scenarios where the UAV supports point-to-point communication and multi-node communication. The comparative algorithms include an algorithm based on a simple distance channel model (DCM) [27], an algorithm based on a statistical distribution probability channel model (SDPCM) [28], and an algorithm based on an average gain probability channel model (AGPCM). In addition, in the final simulation under unknown channel parameters, the method proposed in this article is also compared with the least square estimation (LSE)-based algorithm [35] and the neural network estimation (NNE)-based algorithm [21].

5.2. Stationary Nodes

Using the UAV to support stationary node communication is a simple and common scenario. In the first simulation, the point-to-point relay communication between two stationary UGVs is verified. The initial positions, transmission power, and channel attenuation factors of the ground nodes and the relay UAV are shown in Table 3. It is assumed that the channel parameters of the UGVs are known to the UAV in advance, and the signal frequency is

f_{c} = 2

GHz. The speed of the UAV is

40

m/s, the desired flying radius is

200

m, and the maximum roll angle is

40 °

. The simulation time is

300

s.

Figure 4 shows the simulation results, where circles of different colors represent the boundaries of different types of environmental areas, and curves of different colors represent the UAV relay flight trajectories obtained using different methods; the corresponding communication performance change curves are shown in Figure 5.

The simulation results show that the DCM (distance channel model)-based motion control algorithm drives the UAV to fly around the center of the two UGVs, while the SDPCM (statistical distribution probability channel model)-based motion control algorithm drives the UAV to fly closer to the UGV 2 with smaller transmission power, and the AGPCM(average gain probability channel model)-based motion control algorithm simultaneously takes into account that the UGV 2 has a smaller transmission power and is located in the HighRiseUrban area, where the signal attenuation rate is much greater than that of the Suburban area where the UGV 1 is located. Therefore, it adjusts the UAV to fly closer to the UGV 2. This is also the reason why the initial positions of UGV 1 and UGV 2 are selected in Suburban and DenseUrban, respectively, when selecting simulation parameters. This is because only by making such a selection can the impact of the environment on the channel characteristics be reflected, and then the difference in the implementation effects of motion-control methods based on different channel models can be shown.

Obviously, this result is more in line with the actual situation, which verifies that it is valuable to consider the influence of environmental characteristics on the channel when designing the relay UAV motion-control algorithm. It also shows that it is more reasonable to measure the communication performance of the network based on AGPCM. Figure 5 verifies that the communication performance brought by AGPCM-based motion control method is better than the other two methods.

The second simulation experiment is to verify the use of the UAV to support communication for multiple stationary UGVs. There are 5 stationary UGVs in the task area, with positions of (1500, 1700), (3500, 8000), (2400, 5600), (8000, 4000) and (6000, 3000), respectively, in meters, as illustrated by the blue squares in Figure 6. The transmission power is randomly generated between

100 \sim 200

mW. The initial position of the relay UAV is (3195, 6704), in meters, as shown by the black square in Figure 6. It is also assumed that the UAV has known the channel parameters, and other parameters are set the same as the previous experiment. The simulation results are shown in Figure 6 and Figure 7, respectively. The former gives the flight trajectories of the UAV based on different channel models, and the latter gives the corresponding communication performance change curves.

From Figure 6, it can be observed that the UGV 4 is located in the HighRiseUrban area. Due to the high-density and high-altitude buildings, the wireless information transmission in this area has a low probability of LoS occurrence, resulting in extremely poor communication conditions for the UGVs in this area. By comparing the three different colored relay paths, it can be found that the AGPCM-based motion control algorithm can drive the UAV to a better target position than the DCM-based and SDPCM-based motion control algorithms. In addition, the communication performance change curves in Figure 7 also verify this point because the communication performance curve obtained by the AGPCM-based algorithm is always at the highest position among the three, with the best communication performance, the best relay communication effect, and stable performance.

5.3. Moving Nodes

This section discusses the scenario of using relay UAV to support communication for moving UGVs with known parameters.

In the third simulation, there are two moving UGVs, namely, relay for point-to-point communication. The transmission power of the two UGVs is

100

mW and

200

mW, respectively. The motion trajectory is randomly given according to the smooth turning model, with a speed of

10

m/s. The blue square points in Figure 8 give their initial positions, and the connected blue solid lines are the motion trajectories of the UGVs. The UAV flies at a speed of

40

m/s, with a maximum roll angle of

40^{°}

and a desired flying radius of

200

m, and its initial position is shown by the black square points in Figure 8. The simulation time is

720

s.

Figure 8 shows the flight trajectories of the UAV based on different channel models, and the corresponding communication performance changes are shown in Figure 9. In order to reflect the impact of the environment on channel characteristics, especially the high altitude and high-density buildings in the HighRiseUrban environment, which lead to extremely poor communication conditions and sudden changes in network performance, we specifically let the trajectory of UGV1 pass through the HighRiseUrban area during the simulation. From Figure 9, it can be observed that there is a sudden change in the communication performance, which is due to the UGV 1 moving to the HighRiseUrban area, resulting in extremely poor channel quality. The results of the three algorithms responding to this sudden change show that the AGPCM-based motion-control algorithm has the best performance, and in other non-sudden situations, the results of this algorithm can also provide the same or better performance as other algorithms.

The fourth simulation is used to verify the scenario of using UAV to support communication for multiple moving UGVs. There are 6 UGVs, and the blue square points in Figure 10 represent their starting position. The blue solid line starting from these points represent the motion trajectories of the unmanned vehicles, which are randomly generated under the smooth turning model [21]. The motion speed is

10

m/s, and the transmission power is randomly generated between

100 \sim 250

mW. Other parameters are the same as the third simulation. The simulation results are shown in Figure 10 and Figure 11.

As can be seen from Figure 11, there is also a sudden change in communication performance. This is because the UGV 5 entered the HighRiseUrban area within the time period of 391~504 s, causing the channel quality to become very poor. There are six unmanned ground vehicles, and the motion control algorithm based on AGPCM achieves the best relay communication performance, especially in the case of sudden changes in the communication environment.

The results of simulations 3 and 4 show that the online autonomous motion-control algorithm for the relay UAV proposed in this paper can effectively support the communication for moving UGVs and achieve good communication performance. In addition, considering the impact of the environments on the channel characteristics in the algorithm can bring better communication performance.

5.4. Moving Nodes with Unknown Channel Parameters

This section further discusses the simulation of adaptive online autonomous motion control of the relay UAV supporting communication of moving UGVs under unknown channels. This scenario is also common and most complex in practical applications, requiring the UAV to estimate the wireless channel parameters and the power distribution in the environmental area based on limited sampling. The parameter settings are the same as those in Section 5.3, with the difference being that in this simulation, the channel parameters between the UAV and the UGVs are unknown in advance but are estimated by the Gaussian process learning algorithm in Section 2.2.

Figure 12 and Figure 13 show the UAV flight trajectories and communication performance change curves, respectively. In Figure 12 and Figure 13, by comparing the red curve and the cyan curve, we can see the performance gap between the proposed method in known channels and unknown channels. By comparing the cyan curve and the black curve, we can see the difference in the implementation effects of the proposed GP-based channel estimation method and the LSE(least square estimation)-based channel estimation method. By comparing the green curve and the pink curve, we can see the difference in the implementation effects of the NNE(neural network estimation)-based channel estimation method and the GP-based channel estimation method proposed in this paper. By comparing the cyan curve and the green curve, we can see the difference in the implementation effects of the methods based on different channel models. From the two figures, it can be seen that (1) although the performance of the UAV relay motion-control algorithm under unknown channel parameters proposed in this paper has not reached the theoretical optimal value under known channels, it has already approached the latter; (2) the air-to-ground channel parameter-estimation algorithm based on Gaussian process learning and AGPCM proposed in this paper can effectively estimate the air-to-ground channel parameters; and (3) the results based on the AGPCM algorithm are better than those based on the SDPCM algorithm, especially when the environmental characteristics of the UGVs change. (4) The communication performance obtained by the channel estimation algorithm based on Gaussian process learning is superior to that of the channel estimation algorithms based on LSE and NNE.

Similarly, simulation is conducted on relay for multiple moving UGVs with unknown channel parameters, and the results are shown in Figure 14 and Figure 15. By comparing the flight trajectories in Figure 14 and the communication performance changes in Figure 15, the same conclusion can be drawn.

6. Conclusions

This article solves the problem of using the UAV as an aerial node to support multi-UGV communication in urban environments by jointly considering unknown radio frequency (RF) channel parameters, unknown multi-agent mobility, the impact of the environments on channel characteristics, and the unavailable angle of arrival (AoA) information of the received signals. The problem mainly includes two aspects: channel estimation and optimal relay position search. For the former, a Gaussian process (GP) learning method is proposed to estimate the unknown channel between the UAV and the UGV. It only needs to collect RSS data online, and the prediction effect of this method is better than that of the LSE and CE algorithms. For the latter, a line search algorithm for point-to-point communication and a gradient-based algorithm for multi-node communication are proposed, respectively. Both algorithms only need one-dimensional search, and the convergence conditions and stability proofs of the algorithms are given. Finally, the comparative experimental results under different conditions show that the online autonomous motion-control method of the relay UAV proposed in this article can effectively drive the UAV to reach or track changes in the optimal relay positions, and it is demonstrated that considering the impact of the environments on channel characteristics can bring better relay communication performance.

Future research directions could be (1) extending single-UAV relay to multi-UAV relay; (2) considering the motion control of relay UAVs with obstacle and threat avoidance; (3) considering the impact of UAV height on relay performance, that is, the motion control of relay UAVs in a three-dimensional environment; and (4) considering the optimization of other communication indicators, such as latency, bit error rate, etc.

Author Contributions

Conceptualization, C.T. and B.L.; methodology, C.T.; software, C.T.; validation, C.T. and B.L.; formal analysis, C.T. and B.L.; investigation, C.T.; resources, C.T.; data curation, C.T.; writing—original draft preparation, C.T.; writing—review and editing, C.T. and B.L.; visualization, C.T.; supervision, C.T.; project administration, C.T. and B.L.; funding acquisition, C.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Dataset available upon request from the authors.

Conflicts of Interest

The authors declare no conflict of interest.

References

Guan, Y.; Zou, S.; Peng, H.; Ni, W.; Sun, Y.; Gao, H. Cooperative UAV Trajectory Design for Disaster Area Emergency Communications: A Multi-Agent PPO Method. IEEE Internet Things J. 2023, 56, 2419–2430. [Google Scholar] [CrossRef]
Xu, L.; Cao, X.; Du, W.; Li, Y. Cooperative path planning optimization for multiple UAVs with communication constraints. Knowl. Based Syst. 2023, 26, 150–164. [Google Scholar] [CrossRef]
Nasim, I.; Ibrahim, A.S. Relay Placement for Maximum Flow Rate via Learning and Optimization over Riemannian Manifolds. IEEE Trans. Mach. Learn. Commun. Netw. 2023, 15, 216–229. [Google Scholar] [CrossRef]
Javaid, S.; Saeed, N.; Qadir, Z.; Fahim, H.; He, B.; Song, H.; Bilal, M. Communication and Control in Collaborative UAVs: Recent Advances and Future Trends. IEEE Trans. Intell. Transp. Syst. 2023, 24, 5719–5739. [Google Scholar] [CrossRef]
Mozaffari, M.; Saad, W.; Bennis, M.; Debbah, M. Mobile unmanned aerial vehicles (UAVs) for energy-efficient Internet of Things communications. IEEE Trans. Wirel. Commun. 2017, 16, 7574–7589. [Google Scholar] [CrossRef]
Tang, Q.; Yu, Z.; Jin, C.; Wang, J.; Liao, Z.; Luo, Y. Completed tasks number maximization in UAV-assisted mobile relay communication system. Comput. Commun. 2022, 187, 20–34. [Google Scholar] [CrossRef]
Dixon, C.; Frew, E.W. Optimizing cascaded chains of unmanned aircraft acting as communication relays. IEEE J. Sel. Areas Commun. 2012, 30, 883–898. [Google Scholar] [CrossRef]
Bor-Yaliniz, R.I.; El-Keyi, A.; Yanikomeroglu, H. Efficient 3-D placement of an aerial base station in next generation cellular networks. In Proceedings of the 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia, 22–27 May 2016; pp. 1–5. [Google Scholar]
Choi, D.H.; Kim, S.H.; Sung, D.K. Energy-efficient maneuvering and communication of a single UAV-based relay. IEEE Trans. Aerosp. Electron. Syst. 2014, 50, 2320–2327. [Google Scholar] [CrossRef]
Huang, X.; Fu, X. Fresh data collection for UAV-assisted IoT based on aerial collaborative relay. IEEE Sens. J. 2023, 23, 8810–8825. [Google Scholar] [CrossRef]
Kim, S.; Oh, H.; Suk, J.; Tsourdos, A. Coordinated trajectory planning for efficient communication relay using multiple UAVs. Control Eng. Pract. 2015, 29, 42–49. [Google Scholar] [CrossRef]
Lun, Y.; Yao, P.; Wang, Y. Trajectory optimization of SUAV for marine vessels communication relay mission. IEEE Syst. J. 2020, 14, 5014–5024. [Google Scholar] [CrossRef]
Ouyang, J.; Zhuang, Y.; Lin, M.; Liu, J. Optimization of beamforming and path planning for UAV-assisted wireless relay networks. Chin. J. Aeronaut. 2014, 27, 313–320. [Google Scholar] [CrossRef]
Han, S.I. Survey on UAV deployment and trajectory in wireless communication networks: Applications and challenges. Information 2022, 13, 389. [Google Scholar] [CrossRef]
Chamseddine, A.; Akhrif, O.; Charland-Arcand, G.; Gagnon, F.; Couillard, D. Communication relay for multiground units with unmanned aerial vehicle using only signal strength and angle of arrival. IEEE Trans. Control Syst. Technol. 2017, 25, 286–293. [Google Scholar] [CrossRef]
Zhan, P.; Yu, K.; Swindlehurst, A.L. Wireless relay communications with unmanned aerial vehicles: Performance and optimization. IEEE Trans. Aerosp. Electron. Syst. 2011, 47, 2068–2085. [Google Scholar] [CrossRef]
Oh, H.; Shin, H.S.; Kim, S.; Chen, W.H. Communication-aware trajectory planning for unmanned aerial vehicles in urban environments. J. Guid. Control. Dyn. 2018, 41, 2271–2282. [Google Scholar] [CrossRef]
Yin, D.; Yang, X.; Yu, H.; Chen, S.; Wang, C. An air-to-ground relay communication planning method for UAVs swarm applications. IEEE Trans. Intell. Veh. 2023, 8, 2983–2997. [Google Scholar] [CrossRef]
Wu, G.; Gao, X.; Fu, X.; Wan, K.F.; Di, R.H. Mobility control of unmanned aerial vehicle as communication relay in airborne multi-user systems. Chin. J. Aeronaut. 2019, 32, 1520–1529. [Google Scholar] [CrossRef]
Kim, J.; Ladosz, P.; Oh, H. Optimal communication relay positioning in mobile multi-node networks. Robot. Auton. Syst. 2020, 129, 103517. [Google Scholar] [CrossRef]
Ladosz, P.; Oh, H.; Zheng, G.; Chen, W.H. A hybrid approach of learning and model-based channel prediction for communication relay UAVs in dynamic urban environments. IEEE Robot. Autom. Lett. 2019, 4, 2370–2377. [Google Scholar] [CrossRef]
Wu, J.; Wang, H.; Li, N.; Yao, P.; Huang, Y.; Su, Z.; Yu, Y. Distributed trajectory optimization for multiple solar-powered UAVs target tracking in urban environment by Adaptive Grasshopper Optimization Algorithm. Aerosp. Sci. Technol. 2017, 70, 497–510. [Google Scholar] [CrossRef]
Wan, Y.; Namuduri, K.; Zhou, Y.; He, D.; Fu, S. A smooth-turn mobility model for airborne networks. IEEE Trans. Veh. Technol. 2013, 62, 3359–3370. [Google Scholar] [CrossRef]
Rigatos, G.G. Distributed filtering over sensor networks for autonomous navigation of UAVs. Intell. Serv. Robot. 2012, 5, 179–198. [Google Scholar] [CrossRef]
Al-Hourani, A.; Kandeepan, S.; Lardner, S. Optimal LAP altitude for maximum coverage. IEEE Wirel. Commun. Lett. 2014, 3, 569–572. [Google Scholar] [CrossRef]
Khuwaja, A.A.; Chen, Y.; Zhao, N.; Alouini, M.S.; Dobbins, P. A survey of channel modeling for UAV communications. IEEE Commun. Surv. Tutor. 2018, 20, 2804–2821. [Google Scholar] [CrossRef]
Di, B.; Zhou, R.; Duan, H. Potential field based receding horizon motion planning for centrality-aware multiple UAV cooperative surveillance. Aerosp. Sci. Technol. 2015, 46, 386–397. [Google Scholar] [CrossRef]
Kopeikin, A.; Ponda, S.S.; Inalhan, G. Control of communication networks for teams of UAVs. In Handbook of Unmanned Aerial Vehicles; Springer: Dordrecht, The Netherlands, 2015; pp. 1619–1654. [Google Scholar]
Holis, J.; Pechac, P. Elevation dependent shadowing model for mobile communications via high altitude platforms in built-up areas. IEEE Trans. Antennas Propag. 2008, 56, 1078–1084. [Google Scholar] [CrossRef]
ITU. Propagation Data and Prediction Methods for the Design of Terrestrial Broadband Millimetric Radio Access Systems. 2003. [Google Scholar]
Liu, M.; Chowdhary, G.; Da Silva, B.C.; Liu, S.Y.; How, J.P. Gaussian processes for learning and control: A tutorial with examples. IEEE Control Syst. Mag. 2018, 38, 53–86. [Google Scholar] [CrossRef]
Noack, M.M.; Sethian, J.A. Advanced stationary and nonstationary kernel designs for domain-aware gaussian processes. Commun. Appl. Math. Comput. Sci. 2022, 17, 131–156. [Google Scholar] [CrossRef]
Carfang, A.J.; Wagle, N.; Frew, E.W. Improving data ferrying by iteratively learning the radio frequency environment. In Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA, 14–18 September 2014; pp. 1182–1188. [Google Scholar]
Chamseddine, A.; Akhrif, O.; Gagnon, F.; Couillard, D. Communication relay for multi-ground units using unmanned aircraft. In Proceedings of the 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Phuket, Thailand, 13–15 November 2016; pp. 1–6. [Google Scholar]
Malmirchegini, M.; Mostofi, Y. On the spatial predictability of communication channels. IEEE Trans. Wirel. Commun. 2012, 11, 964–978. [Google Scholar] [CrossRef]

Figure 1. Illustration of air-to-ground relay communication scenario in urban environments.

Figure 2. Motion control framework.

Figure 3. Schematic diagram of air-to-ground signal propagation.

Figure 4. Flight trajectories of the UAV that supports communication for two stationary UGVs.

Figure 5. Changes in communication performance when the UAV supports communication for two stationary UGVs.

Figure 6. Flight trajectories of the UAV that supports communication for multiple stationary UGVs.

Figure 7. Changes in communication performance when the UAV supports communication for multiple stationary UGVs.

Figure 8. Flight trajectories of the UAV that supports point-to-point communication for two moving UGVs.

Figure 9. Changes in communication performance when the UAV supports point-to-point communication for two moving UGVs.

Figure 10. Flight trajectories of the UAV that supports multi-node communication for multiple moving UGVs.

Figure 11. Changes in communication performance when the UAV supports multi-node communication for multiple moving UGVs.

Figure 12. Flight trajectories of the UAV that supports point-to-point communication for two moving UGVs with unknown channel parameters.

Figure 13. Changes in communication performance when the UAV supports point-to-point communication for two moving UGVs with unknown channel parameters.

Figure 14. Flight trajectories of the UAV that supports multi-node communication for multiple moving UGVs with unknown channel parameters.

Figure 15. Changes in communication performance when the UAV supports multi-node communication for multiple moving UGVs with unknown channel parameters.

Table 1. Wireless channel parameters for various types of areas.

Channel Parameter	Suburban	Urban	DenseUrban	HighRiseUrban
$α$	0.1	0.3	0.5	0.5
$β$	750	500	300	300
$γ$	8	5	20	50
$a$	5.0188	9.6101	11.9480	27.1562
$b$	0.3511	0.1592	0.1359	0.1228
$η_{LoS} (dB)$	0.1	1.0	1.6	2.3
$η_{NLoS} (dB)$	21	22	23	34

Table 2. Coverage of various types of areas.

Environmental Areas	Coverage Center		Coverage Radius (m)
Environmental Areas	X(m)	Y(m)	Coverage Radius (m)
Suburban	6000	7000	9000
Urban	6490	4480	3600
DenseUrban	7000	3150	2000
HighRiseUrban	7340	2300	600

Table 3. Parameters for the UGVs and the relay UAV (stationary nodes).

Item	X Coordinate	Y Coordinate	Transmission Power	Attenuation Factor
UGV 1	370 m	2348 m	200 mW	2.2
UGV 2	7701 m	2194 m	100 mW	2.4
Relay UAV	3210 m	6626 m	\	\

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

Share and Cite

MDPI and ACS Style

Tao, C.; Liu, B. Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments. Drones 2024, 8, 771. https://doi.org/10.3390/drones8120771

AMA Style

Tao C, Liu B. Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments. Drones. 2024; 8(12):771. https://doi.org/10.3390/drones8120771

Chicago/Turabian Style

Tao, Cancan, and Bowen Liu. 2024. "Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments" Drones 8, no. 12: 771. https://doi.org/10.3390/drones8120771

APA Style

Tao, C., & Liu, B. (2024). Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments. Drones, 8(12), 771. https://doi.org/10.3390/drones8120771

Article Menu

Online Autonomous Motion Control of Communication-Relay UAV with Channel Prediction in Dynamic Urban Environments

Abstract

1. Introduction

2. System Model and Problem Formulation

2.1. Air-to-Ground Relay Scenario in Urban Environments

2.2. UAV Kinematic Model

2.3. Motion Model of the UGV

2.4. Future Position Prediction Based on Kalman Filter

2.5. Problem Formulation of Optimal Relay Position Search

2.6. Motion Control Framework for Relay UAV

3. Online Estimation of Wireless Channel Parameters

3.1. Model of the Received Signal

3.2. Channel Estimation Based on Gaussian Process

4. Searching for the Optimal Relay Position

4.1. Point-to-Point Communication

4.2. Multi-Node Communication

5. Simulation Results and Analysis

5.1. Simulation Parameters Setting

5.2. Stationary Nodes

5.3. Moving Nodes

5.4. Moving Nodes with Unknown Channel Parameters

6. Conclusions

Author Contributions

Funding

Data Availability Statement

Conflicts of Interest

References

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI