Научная статья на тему 'ITERATIVE LEARNING CONTROL ON NONLINEAR STOCHASTIC NETWORKED SYSTEMS WITH NON-DIFFERENTIABLE DYNAMICS'

ITERATIVE LEARNING CONTROL ON NONLINEAR STOCHASTIC NETWORKED SYSTEMS WITH NON-DIFFERENTIABLE DYNAMICS Текст научной статьи по специальности «Компьютерные и информационные науки»

CC BY
26
10
i Надоели баннеры? Вы всегда можете отключить рекламу.
Ключевые слова
ITERATIVE LEARNING CONTROL / STOCHASTIC NONLINEAR NETWORKED SYSTEM / NON-DIFFERENTIABLE / GLOBAL LIPSCHITS CONTINUOUS (GLC) / DATA DROPOUT

Аннотация научной статьи по компьютерным и информационным наукам, автор научной работы — Najafi Sedigheh Alsadat, Delavarkhalafi Ali, Karbassi Seyed Mehdi

In the design of iterative learning control (ILC) algorithm for stochastic nonlinear networked systems, the underlying assumption is differentiability of the system dynamics. In many cases, in reality, stochastic nonlinear networked systems have non-differentiable dynamics, but their dynamics functions after discretization by using conventional methods have global Lipschits' continuous (GLC) condition. In this paper, we apply an ILC algorithm for stochastic nonlinear networked systems that have the GLC condition. We demonstrate that to design the ILC algorithm, differentiability of the system dynamics is not necessary, and the GLC condition is sufficient for designing the ILC algorithm for stochastic nonlinear networked systems with non-differentiable dynamics. We investigate the analysis of convergence and the tracking performance of the proposed update law for stochastic nonlinear networked systems with GLC condition. We show that there exists no limited condition for the stochastic data dropout probabilities in the convergence investigation of the input error. Then, the results are reviewed and confirmed with a numerical example.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Текст научной работы на тему «ITERATIVE LEARNING CONTROL ON NONLINEAR STOCHASTIC NETWORKED SYSTEMS WITH NON-DIFFERENTIABLE DYNAMICS»

MSC 93Exx

DOI: 10.14529/ mmp210405

ITERATIVE LEARNING CONTROL ON NONLINEAR STOCHASTIC NETWORKED SYSTEMS WITH NON-DIFFERENTIABLE DYNAMICS

Najafi Sedigheh Alsadat1, Delavarkhalafi All1, Karbassi Seyed Mehdi1

1Yazd University, Yazd, Iran

E-mails: se.najafi@stu.yazd.ac.ir, delavarkh@yazd.ac.ir, mehdikarbassi@gmail.com

In the design of iterative learning control (ILC) algorithm for stochastic nonlinear networked systems, the underlying assumption is differentiability of the system dynamics. In many cases, in reality, stochastic nonlinear networked systems have non-differentiable dynamics, but their dynamics functions after discretization by using conventional methods have global Lipschits' continuous (GLC) condition. In this paper, we apply an ILC algorithm for stochastic nonlinear networked systems that have the GLC condition. We demonstrate that to design the ILC algorithm, differentiability of the system dynamics is not necessary, and the GLC condition is sufficient for designing the ILC algorithm for stochastic nonlinear networked systems with non-differentiable dynamics. We investigate the analysis of convergence and the tracking performance of the proposed update law for stochastic nonlinear networked systems with GLC condition. We show that there exists no limited condition for the stochastic data dropout probabilities in the convergence investigation of the input error. Then, the results are reviewed and confirmed with a numerical example.

Keywords: iterative learning control; stochastic nonlinear networked system; non-differentiable; global Lipschits continuous (GLC); data dropout.

Introduction

The use of human learning and experience in doing tasks and success in them is an incentive to develop a control method called iterative learning control. People learn by practicing and repeating a task to perfect it. Due to the nature of ILC, ILC can be used to improve performance in systems that perform repetitive tasks in a limited amount of time. ILC is a control method that is designed for amending tracking control performance when a system is performing a repeating task. The ILC algorithm deals with the reference tracking control problem, which repeats the desired trajectory in a limited time called trial length. ILC is applied to many industrial applications, such as injection molding, robotics, rolling mills, and chemical patch processes, etc. The fundamental idea is to use the tracking error to update the control input signal in the current trial of ILC, and the aim is to attain better tracking performance from trial to trial. The main idea of ILC goes back to the article [1], which is one of the sources of this topic. ILC is extensively studied and researched in theory and is used in practice as well. The paper [2] is a survey that provides an overview of ILC research, and the paper [3] categorizes almost all ILC algorithms proposed between 1998 and 2004 from various aspects, such as mathematical formula, application type, and system type. Stochastic iterative learning control (SILC) is given by iterative learning control concerning systems with stochastic signals such as random data dropout, measurement noise, and system noise. Previously, there are many kinds of research on various issues of ILC, such as robustness, stability, update law design, frequency analysis, and applied research. The papers [2-7] are survey papers in this area of research. The paper [8] presents an ILC algorithm with gain adaptation for discrete-time stochastic systems. The algorithm is based on Kesten's accelerated stochastic approximation algorithm.

With the advancement of Internet services, with the help of network techniques and communication, control systems can be networked to have robustness, high performance, flexibility, facility, and low cost. Control systems with these features organize network control systems (NCSs). In NCSs, the network locates between the controller and the system. The goal is efficient performance in case of lost data. Because of the random lost data, the common control techniques and classical approximation are not used in NCSs. There are several articles on the employment of the ILC algorithm in NCSs according to the data conditions, the convergence analysis, and the design of the compensation structure. The work [9] is a survey concerning ILC with incomplete information and relevant control systems. In [10], a networked iterative learning control (NILC) is designed for a class of uncertain discrete-time nonlinear systems with random packet dropout and communication delay, where the input-output coupling parameter (IOCP) is assumed to be unknown. The work [11] presents a novel networked iterative learning control scheme with an adjustment factor for a class of discrete-time uncertain nonlinear systems with stochastic input and output packet dropout modelled as 0-1 Bernoulli-type random variable.

In the research field of ILC, for nonlinear systems, the following two categories in terms of system nonlinearities are considered: system dynamic with the GLC condition and system dynamic with the local Lipschitz continuous (LLC) functions. In [7], the author designed linear ILC for GLC nonlinear systems and nonlinear ILC for LLC nonlinear systems.

In practice, many industrial plants have nonlinear systems such that, in many cases, ILC design requires that the dynamics of the nonlinear systems is differentiable. However, there exist nonlinear systems, which dynamics are not differentiable. For example, the work [12] explains that the Hamilton-Jacobi equation is a first-order nonlinear partial differential equation for the value function, which is differentiable. However, there exist generally cases such that the value function is not differentiable. In practice, some systems have non-differentiable dynamics. For example, the dynamics of impulsive systems and backlash in gears may be non-differentiable. Therefore, this motivated us to design an ILC algorithm to improve the performance of such systems with non-differentiable dynamics. In this paper, it is assumed that systems with non-differentiable dynamics have data dropout and are networked.

We can apply a more relaxed condition for stochastic nonlinear networked systems such that their dynamic is not differentiable. In this paper, we design an ILC update law for stochastic nonlinear networked systems such that the system dynamics are not differentiable, but they have the GLC condition after discretization by using conventional methods. We determine that to design the ILC update law, differentiability of the system dynamics is not necessary, while the GLC condition is sufficient to generate the ILC update law for stochastic nonlinear networked systems with non-differentiable dynamics. We analyze convergence and the tracking performance of the recommended algorithm for stochastic nonlinear networked systems that have GLC condition.

The aim of this paper is to show that the non-differentiability of the system dynamics is not an obstacle for the design of the ILC algorithm and is possible by considering a more relaxed condition, namely, the GLC condition.

In the convergence analysis of the ILC algorithm, although the dynamics of the stochastic nonlinear networked system are not differentiable, there is no problem in proving the convergence theorem, and the GLC condition is sufficient to prove the convergence of the ILC algorithm.

Notations. We denote the real number field by R. "P" shows the probability of an event. "E" indicates mathematical expectation. Superscript "T" indicates the transpose of a vector or matrix. |.| denotes absolute value. "i.o." indicates "infinitely often", "a.s." shows "almost surely" and "w.p.1." denotes "with probability one". "i.i.d." stands for "independent and identically distributed".

The paper is organized as follows. In Section 2, we formulate the problem statement and present an ILC update law for stochastic nonlinear networked systems that have the GLC condition. Section 3 investigates the convergence analysis of the proposed algorithm. In Section 4, we consider a numerical example, and, in Section 5, we draw a conclusion.

1. Problem Statement

Consider a continuous-time stochastic nonlinear networked system with non-differentiable dynamics. After discretization by conventional methods such as Euler method, the system is reduced to the following discrete-time nonlinear networked system with stochastic measurement noise:

Xk (t + 1) = f (t, Xk (t)) + g (t, xk (t)K (t), Ук (t) = C (t)xk (t)+ Zk (t),

(1)

where k = 1, 2,... indicates the iteration index, t = 0,1,N is the time index, and the given positive integer N is the iteration length. uk(t) G R, yk(t) G R, and xk(t) G Rn are the input vector, the output vector, and the state vector, respectively. The stochastic variable (k(t) indicates measurement noise. Nonlinear functions f (t,xk(t)), g(t,xk(t)), and time-varying vector C(t) represent unknown information on the system.

In ILC networked control systems, the networks are applied to communicate between the iterative learning controller and the operational system. We use the Bernoulli random variables to denote the lost data in this paper, similar to some literature about NCSs. We use ak (t) with the Bernoulli distribution for modelling the transmission of yk(t). Therefore, if yk(t) is not successfully transmitted, then ak(t) = 0, and if yk(t) is successfully transmitted, then ak(t) = 1. We assume that the probability of successfully output transmission is 0 < r < 1. Therefore,

Fig. 1. A control system with a network at the measurement side

P(ak(t) = 0) = 1 - r, Vk, t and P(a(t) = 1) = r. Hence, we conclude that Ea(t) = r. Some of the assumptions are as follows.

A1. There exists a unique ud(t) for generating the desired output yd(t) with the initial

state xd(0), where yd(0) = C(0)xd(0) is such that

Xd (t + 1) = f (t,Xd(t)) + g(i,xd(i))ud(i),

yd(i) = C(t)xd(t). ( )

A2. Vt the i.i.d measurement noise sequence Zk(t),k = 0,1,... has E(k(t) = 0,

2 n T

supfcE|(k(i)| < to, and lim ^ (k(t) ((kit)) = (t a.s. such that (t is an unknown matrix.

n k=l

Remark 1. The condition utilized to the noise measurement is based on the iteration axis rather than the time axis, and, since the process is performed repeatedly and independently, therefore, there are no rigorous conditions.

A3. Vt = 0,1,...,N, nonlinear functions f(t,xk(t)) and g(t,xk(t)) have the GLC condition, that is, Vxl, x2 G Rn, |f (t,xl) — f (t,x2)| < lf |xl — x2| and Vxl, x2 G Rn, |g(t,xl) — g(t,x2)| < lg |xl — x21, where lf > 0 and lg > 0 are the Lipschitz constants.

Remark 2. This is the GLC condition, which we use to design the ILC algorithm and analyze its convergence.

A4. It is supposed that the sign of C(t + 1)g(t,xk(t)) does not change during the learning process, and its unknown value is nonzero. Therefore, it is assumed that C(t + 1)g(t,xk(t)) > 0.

Remark 3. C(t + 1)g(t, xk(t)) indicates the control direction. Assumption A4 is necessary because otherwise a plan must be design to find the direction of right control, which complicates the controller.

A5. The measurement noise sequence and the initial state sequence are mutually independent. Furthermore, the i.i.d initial state sequence is resetting asymptotically in the sense that xk(0) ^ xd(0), w.p.1, when k ^ to.

Remark 4. This technique is necessary to realize the asymptotically re-initialization condition. Remarkably, the classical identical initial condition is a particular case of A5.

In Figure 1, the system output of the current iteration transfers via the network to the ILC controller. In this paper, we consider just data dropouts on the measurement side.

Remark 5. If we consider lost data on both actuator and measurement sides, a more comprehensive investigation is required because we need to consider the asynchronous update between the control signal created by the learning controller and the control signal fed to the plant. Since this is beyond the scope of this paper, for example, refer to [13] for more study.

A mechanism is needed to ensure the convergence of the input error to zero and to overcome the effect of random noise on random systems. Therefore, to eliminate the effect of measurement noise, ensure input convergence and prevent unstable conditions, we consider the following decreasing sequence pk for the proposed update algorithm:

<x <x

Pk > 0, Pk ^ 0,J> = TO, J^P2 < to, Vk = 1, 2, .... (3)

k=1 k=1

In this paper, we design the ILC algorithm for stochastic nonlinear systems with non-differentiable dynamics with GLC condition for updating and generating inputs due

n

to minimizing limsup ^ \yd.it) — yuit) | , Vt = 0,1,..., N under the lost data conditions.

n ^^O k=1

Due to the unpredictable measurement noise, this article deals with the direct convergence of system inputs to the desired input.

Indeed, we can not use conventional update control laws for networked systems. In this paper, the following ILC update law is proposed under stochastic measurement noises for stochastic nonlinear systems that have GLC condition:

ufc+i(t) = ufc (t) + pfc E (t + 1), (4)

where

(t) = f efc (t), i/afc (t) = 1, (5)

k () \ 0, i/afc (t) = 0,

ek(t) = yd(t) — (t) is the tracking error.

We present the convergence analysis of ILC update law (4), (5) as well as its performance evaluation for stochastic nonlinear networked systems with non-differentiable dynamics that after discretization have GLC condition.

2. Convergence Analysis

Let us show the convergence analysis of the recommended law (4), (5). For brevity, we use the symbols fk(t) = f (t, xfc(t)), fd(t) = f (t, xd(t)), gk(t) = g(t, xfc(t)), gd(t) = g(t, xd(t)), ¿fk(t) = fd(t) - fk(t), and ¿gk(t) = gd(t) - gk(t). The status error is defined with ¿xk(t) = xd(t) — xk(t). We use the following statement to prove the convergence of the algorithm (4), (5).

Lemma 1. For system (1), assumptions A1-A5 are considered. If lim ¿uk(m) = 0, m =

k—^^o

0, 1, ..., t, then we have f(t + 1)| -> 0, |5gk(t + 1)| -► 0, and |ixk(t + 1)| -> 0,

k—те k—те k—те

w.p.1, at the time t + 1.

Proof. Taking into account (1) and (2), we conclude that

¿Xk (t + 1) = ¿fk (t) + gk (t)^Uk (t) + ¿gk (t)Ud(t). (6)

Let us prove by mathematical induction. Initial step. Let t = 0, we have

¿Xk (1) = ¿fk (0) + gk (0)5uk (0) + ¿gk (0)ud(0) (7)

Concerning A5, ¿xk(0) -^ 0, take into account A3 ¿fk(0) -> 0 and ¿gk(0) -> 0.

Since |gk(0)| < |gd(0)| + |¿gk(0)|, we conclude that gk(0) is bounded. Therefore, considering assumptions of Lemma 1, ¿uk(0) -> 0, we have gk(0^uk(0) -> 0. Also, ud(0) is

the initial desired input vector, therefore, ud(0) is bounded. Hence, we conclude that ¿gk(0)ud(0) -> 0. Therefore, from (7), we conclude that ¿xk(1) -> 0. Now, concerning

k—те k—те

A3, we have ¿fk(1)-> 0 and ¿gk(1) -> 0.

k—те k—те

Inductive step. Suppose that the results of Lemma 1 hold for i = 0,1, ...,t. We show that conclusions are correct for t +1. The method of proof is the same as the initial step of induction. Therefore, it is proven that /k(t + 1) -> 0, (t + 1) -> 0 and

k—TO k—TO

(t + 1) -► 0.

k—TO LI

In this regard, for convergence investigation, the following statement is proved.

Theorem 1. Suppose that assumptions A1-A5 hold for the stochastic nonlinear networked system (1). If |1 — pkC(t + 1)gk(t)| < 1, then for uk(t) updated by ILC update law (4), we conclude that uk(t) ^ ud(t) w.p.1, for all t when k ^ to.

Proof. To prove convergence it is necessary to show that (t) = ud(t) — uk (t) ^ 0 for all t = 0,1, ..., N when k ^ to.

Considering (1) and (2), according to (4) and (5), we have

¿«fc+i(t) = iufc (t) — pk Efc (t + 1) = iufc (t) — pfc afc (t + 1)efc (t + 1) =

= ¿ufc (t) — pk afc (t + 1)C (t + 1)(xd(t + 1) — xk (t + 1))+ (8)

+Pk ak (t + 1)Zk (t + 1).

Therefore, again considering (1) and (2), we conclude that

¿Ufe+i(t) = (t) — Pk C (t + 1)gk (t)^Mk (t) + Pk C (t + 1)gk (t)^Mk (t) —

—Pk ak (t + 1)C (t + 1)fk (t) — Pk ak (t + 1)C (t + 1)fyk (t)ud(t)— (9)

—Pk ak (t + 1)C (t + 1)gk (t)iuk (t) — Pk ak (t + 1)Zk (t + 1).

Hence, we have

<fak+i(t) = [1 — Pk C (t + 1)gk (t)]<fak (t) + Pk C (t + 1)gk (t)iuk (t) — —Pk ak (t + 1)C (t + 1)/ (t) — Pk ak (t + 1)C (t + 1)5gk (t)ud(t)— (10)

—Pk ak (t + 1)C (t + 1)gk (t)iuk (t) + Pk ak (t + 1)Zk (t + 1).

Considering that Zk (t + 1) is independent of ak (t + 1), and the norm is taken from both sides of (10), we have

|<fak+i(t)| < |1 — PkC(t + 1)gk(t)| |<fak(t)| + |Pk| |C(t + 1)| |gk(t)| |5uk(t)| + + |Pk| |ak(t + 1)| |C(t + 1)| /(t)| + |Pk| |ak(t + 1)| |C(t + 1)| (t)| |ud(t)| + (11) + |Pk| |ak(t + 1)| |C(t + 1)| |gk(t)| |5uk(t)| + |Pk| |ak(t + 1)| |Zk(t + 1)| a.s.

We can prove lim (t) = 0, Vt by mathematical induction.

k—>-<TO

Initial step. Assume that t = 0.

Nk+i(0)| < |1 — PkC(1)gk(0)| |5uk(0)| + |Pk| |C(1)| |gk(0)| |5uk(0)| + + |Pk| |ak(1)| |C(1)| /(0)| + |Pk| |ak(1)| |C(1)| |igk(0)| |ud(0)| + (12)

+ |Pk| |ak(1)| |C(1)| |gk(0)| |iuk(0)| + |Pk| |ak(1)| |Zk(1)| a.s.

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

According to A4, for sufficiently large k, we conclude that C(1)gk(0) > —, where — is a suitable constant. Note that ak(1) and |C(1)| are bounded. Considering A5, we have #xk(0) ^ 0, therefore, according to A3, we conclude that /k(0) ^ 0. Hence, |Pk| |ak(1)| |C(1)| |/k(0)| ^ 0 w.p.1, when k ^ to. In (12), the initial desired input

vector is ud(0), therefore, the norm of ud(0) is bounded. Hence, concerning lim pk = 0,

fc^-TO

we conclude that |pk| |ak(1)| |C(1)| |#gk(0)| |ud(0)| ^ 0 w.p.1, when k ^ to. Also, iuk(0) is the input error vector, therefore, its norm is bounded. Therefore, we have |pk||C(1)| |gk(0)| (0)| ^ 0 and |pk|K(1)||C(1)| |gk(0)| |5ufc(0)| ^ 0, w.p.1, when k ^ to. (1) is a continuous function of white noise on [0, N], therefore, |(k(1)| is bounded. Therefore, concerning lim pk = 0, we have |pk| |ak(1)| |Zk(1)| ^ 0, w.p.1, when

fc^-TO

k ^ to.

We set a1 = |1 — pkC(1)gk(0)|, a^ = 0, i = 2, 3, ..., ek = |#uk(0)|, and = 0, concerning the assumption of Theorem 1 and Lemma 1 of the paper [14], from inequality (12), we result lim |$«fc(0)| = 0, w.p.1.

fc^-TO

Inductive step. It is assumed that (m) ^ 0 is true for m = 0,1, ...,t — 1, then we show (m) ^ 0 for m = t. ak(t + 1) and |C(t + 1)| are bounded. In (11), concerning the inductive assumption and Lemma 1, we conclude that #xk(t) ^ 0 and /k(t) ^ 0. Hence, in (11) we have |pk| |ak(t + 1)| |C(t + 1)| |/k(t)| ^ 0 w.p.1 when k ^ to.

Note that ud(t) is the desired input vector, therefore, its norm is bounded. Hence, concerning lim pk = 0, we conclude that |pk| |ak(t + 1)| |C(t + 1)||#gk(t)| |ud(t)| ^

fc^-TO

0 w.p.1, when k ^ to. Also, (t) is the input error vector, therefore, its norm is bounded. Therefore, we conclude that |pk| |C(t + 1)| |gk(t)| |#uk(t)| ^ 0 and p| K(t + 1)| |C(t + 1)| |gfc(t)| |5ufc(t)| ^ 0, w.p.1, when k ^ to.

|(fc(t + 1)| is bounded, since Zk(t + 1) is a continuous white noise function on [0, N]. Concerning lim pk = 0, we have |pk| |ak(t + 1)| |(k(t + 1)| ^ 0 w.p.1, when k ^ to.

fc^-TO

Let a1 = |1 — pkC(t + 1)gk(t)|, a^ = 0, i = 2, 3, ..., ek = |#uk(t)|, and = 0, concerning |1 — pkC(t + 1)gk(t)| < 1, Lemma 1 of the paper [14], and (13), we conclude that lim |#uk(t)| = 0, w.p.1. n

Therefore, in the ILC update law (4), (5), we proved that the input error converges to zero w.p.1 when k ^ to.

Although the system dynamics are assumed to be non-differentiable, there is no disturbance in proving the convergence of the algorithm (4), (5), and the GLC condition is sufficient to prove the convergence of the algorithm.

3. Numerical Example

In this section, in order to demonstrate the convergence feature of the proposed algorithm (4), (5), we consider the following stochastic nonlinear networked system that have GLC condition:

4(t + 1) = xl(t) sin(|xl(t) - 3|) + i sin(|4(i) - 3\)uk(t) xk(t + 1) = 0, 3 cos(t) cos(xk(t)) + 0, 75 uk(t), yk(t) = 0, 2xk(t) + 0, 35 t°>15x|(t) + Cfc(t).

(13)

Here uk(t) is the input, yk(t) is the output, and

xk(t)

(t)

is the state vector of system

(13). The measurement noise of system (13) is Zk(t) with normal distribution N(0, 0, 012) The time interval is [0,60], and the desired output is yait) = 0,85sin(^i) + 0,3sin(-^i) The initial iteration input signal is u1(t) = 0. The initial state is x1 (0)

(0)

7Г .

15'

0. In the

following, the convergence characteristics of the model (4), (5) and tracking performances

Fig. 2. Tracking performances of system (13) for r = 0, 9

Fig. 3. Average absolute tracking errors of system (13) for r = 0, 9

are examined according to the different probabilities of lost data. To evaluate tracking performance, the proposed algorithm is executed for 500 repetitions.

Fig. 4. Tracking performances of system (13) for r = 0, 3

Fig. 5. Average absolute tracking errors of system (13) for r = 0, 3

0, 9.

First, we set r = 0, 9. Figure 2 shows tracking performance of system (13) for r As can be observed, the final output almost corresponds to the desired output.

Figure 3 presents the average absolute tracking error of outputs for r = 0, 9. Figure 2 and Figure 3 indicate that the proposed algorithm has good tracking performances and is effective.

In the other case, consider r = 0, 3. Figure 4 presents the tracking performance of the system for r = 0, 3. Figure 5 shows the average absolute tracking error of outputs for r = 0, 3. As it is observed, the probability of successful transfer of data for r = 0, 30 is low, and update law performance is worse than for the case r = 0, 9. But while the probability of successful transmission of data is low, performance is not bad.

Then, we set r = 0, 9, 0, 7, 0, 5, and 0, 3, for the examination of the influence of various probabilities of lost data. As can be observed in Figure 6 and Figure 7, the algorithm almost retains its good performance, even if the probability of successful data transfer decreases with the increasing number of iterations.

In this example, we found that the non-differentiability of system did not disrupt the convergence and performance of the proposed algorithm, and the GLC condition is sufficient.

0 50 1 00 150 200 250 300 350 400 450 500

iteration number

J 50 1 00 150 200 250 300 350 400 450 500

iteration number

0 10 20 30 40 50 60

iteration number

Fig. 6. Final outputs of system (13) for r = 0, 9, r = 0, 7, r = 0, 5, r = 0, 3

Conclusion

Fig. 7. Average absolute tracking error of system (13) for r = 0, 9, r = 0, 7, r =

0, 5, r = 0, 3

Differentiability of a system is one of the main assumptions for designing ILC algorithms in stochastic nonlinear networked systems. In this paper, in cases where stochastic nonlinear networked systems have non-differentiable dynamics, we designed the ILC algorithm for such systems based on the GLC condition.

We examined the analysis of convergence and the tracking performance investigation of the introduced algorithm. In this paper, in these stochastic nonlinear networked systems that have GLC condition, the random lost data was set in the measurement side. We modelled the random lost data by random Bernoulli variables.

As it turned out, there is no restricted condition for the stochastic lost data probabilities in the convergence investigation of the input error. Also, we showed that to present the ILC algorithm, differentiability of the system dynamics is not necessary, and the GLC condition is enough for generating the ILC algorithm for stochastic nonlinear networked systems. We showed that, in the ILC update law (4), (5), if |1 — pkC(t + 1)gk(t)| < 1, then the input error converges to zero in the almost sure sense. The theoretical conclusions were confirmed by a numerical example.

References

1. Masaru Uchiyama. Formulation of High-Speed Motion Pattern of a Mechanicalarm by Trial. The Society of Instrument and Control Engineers, 1978, vol. 14, no. 6, pp. 706-712. DOI: 10.9746/sicetr1965.14.706

2. Bristow D.A., Tharayil M., Alleyne A.G. A Survey of Iterative Learning Control: a Learning-Based Method for High-Performance Tracking Control. Control Systems, 2006, vol. 26, no. 3, pp. 96-114. DOI: 10.1109/MCS.2006.1636313

3. Hyo-Sung Ahn, YangQuan Chen, Moore K. Iterative Learning Control: Brief Survey and Categorization. Transaction on Systems, Man and Cybernetics. Applications and Reviews, 2007, vol. 37, no. 6, pp. 1099-1121. DOI: 10.1109/TSMCC.2007.905759

4. Moore K.L., Dahleh M., Bhattacharyya S.P. Iterative Learning Control: A Survey and New Results. Journal of Robotic Systems, 1992, vol. 9, no. 5, pp. 563-594.

5. Dong Shen, Youqing Wang. Survey on Stochastic Iterative Learning Control. Journal of Process Control, 2014, vol. 24, pp. 64-77. DOI: 10.1016/j.jprocont.2014.04.013

J 5U 1UU 15U 2UU 25U 3UU 35U 4UU 45U 5UU

iteration number

6. Youqing Wang, Furong Gao, Doyle F.J. Survey on Iterative Learning Control Repetitive Control and Run-to-Run Control. Journal of Process Control, 2009, vol. 19, no. 10, pp. 1589-1600. DOI: 10.1016/j.jprocont.2009.09.006

7. Jian-Xin Xu. A Survey on Iterative Learning Control for Nonlinear Systems. International Journal of Control, 2011, vol. 84, no. 7, pp. 1275-1294. DOI: 10.1080/00207179.2011.574236

8. Dong Shen, Jian-Xin Xu. An Iterative Learning Control Algorithm with Gain Adaptation for Stochastic Systems. Automatic Control, vol. 65, no. 3, pp. 1280-1287. DOI 10.1109/TAC.2019.2925495

9. Dong Shen. Iterative Learning Control with Incomplete Information: a Survey. Journal of Automatica Sinica, 2018, vol. 5, no. 5, pp. 885-901. DOI: 10.1109/JAS.2018.7511123

10. Yamiao Zhang, Jian Liu, Xiaoe Ruan. Networked Iterative Learning Control for Systems with Packet Dropout and Communication Delay. IFAC-PapersOnLine, 2019, vol. 42, pp. 117-122.

11. Yamiao Zhang, Jian Liu, Xiaoe Ruan. Iterative Learning Control for Uncertain Nonlinear Networked Control Systems with Random Packet Dropout. International Journal of Systems Science, 2019, vol. 13, pp. 1-18. DOI: 10.1002/rnc.4568

12. Fleming W.H., Soner H.M. Generalized Solutions of Hamilton-Jacobi Equation to a Molecular Genetic Model. Advances in Information and Communication Technology, 2006, vol. 27, pp. 42-44. DOI: 10.1007/978-3-319-55795-344

13. Dong Shen, Jian-Xin Xu. A Novel Markov Chain Based ILC Analysis for Linear Stochastic Systems Under General Data Dropouts Environments. Automatic Control, 2017, vol. 62, no. 11, pp. 5850-5857. DOI: 10.1109/TAC.2016.2638044

14. Jian Liu, Xiaoe Ruan. Networked Iterative Learning Control for Discrete-Time System with Stochastic Packet Dropouts in Input and Output Channels. Advances in Difference Equations, 2017, vol. 2017, pp. 1-21. DOI: 10.1186/s13662-017-1103

15. Wei Zhou, Miao Yu, De-Qing Huang. A High-order Internal Model Based Iterative Learning Control Scheme for Discrete Linear Time-varying Systems. International journal of Automation and Computing, 2015, vol. 12, no. 3, pp. 330-336. DOI: 10.1007/ s11633-015-0886-x

Received February 22, 2021

УДК 517.977.5 Б01: 10.14529/шшр210405

УПРАВЛЕНИЕ НЕЛИНЕЙНЫМИ СТОХАСТИЧЕСКИМИ СЕТЕВЫМИ СИСТЕМАМИ С НЕДИФФЕРЕНЦИРУЕМОЙ ДИНАМИКОЙ С ИТЕРАТИВНЫМ ОБУЧЕНИЕМ

Наджафи Седигех Альсадат1, Делавархалафи Али1, Карбасси Сейед Мехди1

1 Университет Йезд, Йезд, Иран

При разработке алгоритма управления с итеративным обучением (ГЬО) для стохастических нелинейных сетевых систем основным предположением является дифферен-

цируемость динамики системы. Во многих случаях в действительности стохастические нелинейные сетевые системы обладают недифференцируемой динамикой, но их динамические функции после дискретизации с использованием обычных методов имеют глобальное непрерывное условие Липшица (СЬС). В этой статье мы применяем алгоритм 1ЬС для стохастических нелинейных сетевых систем, которые имеют условие СЬО. Мы демонстрируем, что для разработки алгоритма 1ЬС дифференцируемость динамики системы не требуется, а условие СЬО достаточно для разработки алгоритма 1ЬС для стохастических нелинейных сетевых систем с недифференцируемой динамикой. Мы исследуем анализ сходимости и отслеживаемость предложенного обновленного закона для стохастических нелинейных сетевых систем с условием СЬС. Мы показываем, что не существует ограниченного условия для вероятностей выпадения стохастических данных при исследовании сходимости входной ошибки. Затем результаты рецензируются и подтверждаются численным примером.

Ключевые слова: управление с итеративным обучением; стохастическая нелинейная сетевая система; недифференцируемый; глобальное непрерывное Липшица (СЬО); пропадание данных.

Седигех Алсадат Наджафи, Йездский университет (г. Йезд, Иран), se.najafi@stu.yazd.ac.ir.

Али Делавархалафи, Йездский университет (г. Йезд, Иран), delavarkh@yazd.ac.ir.

Сейед Мехди Карбасси, Йездский университет (г. Йезд, Иран), mehdikarbassi@gmail.com.

Поступила в редакцию 22 февраля 2021 г.

i Надоели баннеры? Вы всегда можете отключить рекламу.