-□ □-
Розроблено посльдовнийрекурсивный алгоритм фЫьт-ра Калмана для фЫьтрацп даних в областi шумгв eid-мшних eid гаусовського розподЫу для використання у вимiрювальнiй технщи Ыдмгнною рисою розробле-ного алгоритму фЫьтра Калмана для фЫьтрацп даних з негаусовськими шумами е вiдсутнiсть необх{дно-crni апрюрного визначення статистичних характеристик шуму.
Була перевiрена працездаттсть розробленог методики фЫьтрацп Калмана шляхом обробки рiзних закотв розпоЫлу: шумгв Kami, Парето, нормального i логктично-го розnодiлiв. Ефективтсть розробленог методики фЫьтрацп тдтверджуеться шляхом застосування фЫьтра при обробц експериментальних даних зрЬними законами розпоЫлу шумiв. Проведено апробащюрозробленог методики фЫьтрацп Калмана для даних, отриманих експери-ментально з урахуванням суперпозицп закотв розпоЫлу шумгв. Апрюрна оцнка помилки фЫьтрацп при кiлькостi терацй бЫьше 30 прагне до нуля.
Розроблена методика фЫьтрацп з використанням фЫьтра Калмана може бути використана при прове-дент метрологiчног атестацп засобiв вимърювальног техтки в умовах пгдприемства. В цй ситуацп можливе зашумлення вимърювальног тформацп рiзними шумами, в тому чи^i i тими, що не тдкоряються закону розпо-Ылу Гауса. Фъльтр може бути використаний при оброб-ц даних систем контролю параметрiв стану, що реалi-зуються за принципом порогового контролю величини.
Прикладним аспектом використання отриманого нау-кового результату е можливкть розширення областi застосування класичного фЫьтра Калмана в вимърю-вальнш технщи Це становить передумови для розробки утверсального алгоритму фЫьтрацп з використанням фЫьтра Калмана
Kлючовi слова: фЫьтр Калмана, рекурсивний алгоритм, Python, негауссовских шум, закон розподЫу -□ □-
UDC 681.2+621.3.082.1
|DOI: 10.15587/1729-4061.2018.140649|
EXAMINING THE KALMAN FILTER IN THE FIELD OF NOISE AND INTERFERENCE WITH THE NON-GAUSSIAN DISTRIBUTION
O. Oliynyk
PhD, Associate Professor* E-mail: oleinik_o@ukr.net Y. Taranen ko Doctor of Technical Sciences, Professor, Head of Department* E-mail: taranen@rambler.ru D. L o s i k h i n Senior Lecturer* E-mail: loshindima@gmail.com A. Shvachka PhD, Associate Professor* E-mail: AleksandrShvachka@gmail.com *Department of Computer-integrated Technologies and Metrology Ukrainian State University of Chemical Technology Gagarina ave., 8, Dnipro, Ukraine, 49005
1. Introduction
The Kalman filter is a series recursive algorithm that uses a dynamic system model adopted to provide an estimate. The resulting estimation can be significantly adjusted as a result of the analysis of each new measurement sample of sensor over a time sequence [1].
The classic Kalman filter is an equation for the calculation of the first and second moment of a posteriori probability density (vector of mathematical expectation and variance matrix, including mutual) under given constraints. Since for the normal probability density mathematical expectation and variance matrix fully assign a probability density, we can say that the Kalman filter calculates the a posteriori probability density of the state vector at each point in time. And it means that it fully describes the state vector as a random vector magnitude [2]. The estimated values for mathematical expectations in this case are the optimal estimates for the mean square error criterion, which actually predetermines wide application of the Kalman filter.
The Kalman filter is widely used to solve numerous general engineering and econometric applied problems in
the fields with a widespread distribution of Gaussian noise (economic forecasting, electronics, measuring equipment, radio engineering and communications) [3, 4]. Development of statistical models for indicators of processes in technology and economy [5], forecasting and determining the dynamics of economic indicators [6], cleaning of signals of measuring and radio engineering from noise and interference [7] is solved now employing the Kalman filter.
In a classic problem statement, the filter monitors a random signal generated by a linear recursion with additive white noise. The observed process is a linear combination of the signal and other white noise [9]. The impact of noise, interference on all elements of a device causes the emergence of random unique deviations of separate points of the static characteristic of the device [9]. In this case, an error of noise is a nonstationary random function of time. The most common normal (Gaussian) distribution in which the probability density of finding an object with the magnitude of attribute x depends on two parameters: the variance o2 and the offset equal to the mathematical expectation x.
However, the opinion of the universal applicability of the normal distribution is a very stable delusion. Statistical
©
models and methods based on Gaussianity (in particular the estimates of confidence intervals for selective medium) are often applied without a basic check, by default [10].
Therefore, the task to develop an effective procedure for filtering using the Kalman filter in the field of noises that differ from the Gaussian distribution in order to apply it in measuring instruments is a relevant scientific and applied task.
2. Literature review and problem statement
For the non-Gaussian noise, the most commonly used approach implies the approximation of noise applying the noise models, and the filters are then employed that exploit algorithms developed for the Gaussian noise models [11].
There are several varieties of the Kalman filter that differ in the approximations used to linearize dynamic models [12]:
- the extended Kalman filter (EKF) that applies to non-linear models, it performs the linearization through decomposition into a Taylor series;
- the unscented Kalman filter (UKF) that is used in problems for which a simple linearization cannot be applied, it performs «linearization» using a sigma conversion.
Paper [13] proposes for a situation when the signals are often non-linear in dynamics and have an abnormal noise to use the extended Kalman filter. The effectiveness of development is confirmed for the case when the noise variance is not too large (that is, a linear approximation is adequate). However, authors of the study did not consider the region of noises, which are not characterized by parameters of the Gaussian distribution. That is why the developed extended Kalman filter can be applied for filtering the non-Gaussian noise.
The author of [14], given the lack of filtering procedure using the Kalman filter and the impossibility of its application to the non-Gaussian noise domain, synthesized a recurrent non-linear filter whose order is determined from the conditions for obtaining estimates at a rate of measurements acquisition. The paper describes the Gaussian and linearized approximations to an arbitrary order filter, however, the problem on filtering the non-Gaussian noises was never solved.
In paper [15], authors note that modifications of the Kalman filter cannot solve the problems on the non-linear filtering, as the filter is built on only two statistical characteristics of a process: mathematical expectation and a covariance function. This is due to the fact that the study addressed only the two specified statistical characteristics of the filtering process. In this case, the phenomena of superposition of distribution laws under which the given statistical characteristics do not characterize the noise parameters before and after filtering at all, were not taken into account in study [15]. However, there are data that suggest the possibility of obtaining the Kalman filter with nonlinear additional filters, which would make it possible to extend the scope of filter application in measurement technology [16]. We did not find any data in the scientific literature about implementing the Kalman filter that performs the filtering of the non-Gaussian noise.
Therefore, the development of a procedure of filtering using the Kalman filter in the field of the non-Gaussian noise would substantially extend the scope of filter application: signal processing when conducting metrological certification, control over parameters.
3. The aim and objectives of the study
The aim of this study is to develop an effective procedure of filtering using the Kalman filter in the field of noises that are different from the Gaussian distribution in order to apply it in measurement instruments.
To accomplish the aim, the following tasks have been set:
- to perform a comparative analysis of the laws of measurement errors distribution employing the software that makes it possible to simulate the noise effect that is governed by the considered distributions;
- to test the effectiveness of the Kalman filtering procedure by employing different laws of noise distribution;
- to verify the developed procedure of filtering for data obtained experimentally, with respect to the superposition of laws of noise distribution.
4. Investigating the Kalman filter in the field of noises that differ from the Gaussian distribution
Paper [17] reported a model of simple scalar implementation of the Kalman filter by the general-purpose programming tools Python. Simulation confirmed the possibility for applying the developed software implementation of the adaptive Kalman filter to compensate for the effects of amplitude and phase distortions in a data transmission channel. The data abode by the Gaussian distribution. No study was conducted outside the Gaussian domain.
To fulfill the tasks set in this work, the main challenge is the substantiated identification of laws for data measurement error distribution for the non-Gaussian noise.
From the standpoint of probability theory, the form of a numerical distribution law is characterized by its coun-terexcess with a coefficient, which is determined by the standard deviation o and the fourth central moment |m4. According to the information theory, a distribution law is characterized by the value of entropy coefficient k = A / o. For all possible existing laws of distribution, the value of a psi coefficient ranges from 0 to 1, and k - from 0 to 2.076, which is why the identification of distribution laws for the non-Gaussian noise is conveniently considered in the (psi,k)-plane, in which each law is identified by a certain point [18].
A comparative analysis and identification of the measurement error distribution laws were carried out by means of Python. At present, Python is an ideal language in order to rapidly write different applications running on the most common platforms [19]. Python is a freely available software package, which enables wide use of development results.
Result of the analysis is shown in Fig. 1. The chart displays the most common measurement error distribution laws divided into two groups.
The plane in the lower left corner shows the Pareto, Poisson, Cauchy law, and the upper right corner exhibits a group of laws, similar to the Gaussian laws by their information indicators.
The data represented on the plane can be complemented through the introduction of the unused distribution laws. To investigate the effect of the Kalman filtering, we selected four distribution laws, which are in extreme positions on the plane. For the further analysis, we selected the Pareto, Cauchy laws (extreme left) and the logistic and normal distribution (extreme right).
o o
a, o
a
w
1.75 1.50 1.25 1.00 0.75 0.50 0.25
0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 Coefficients psi
Fig. 1. A comparative analysis of the measurement error distribution laws: • — uniform distribution; o — logistic distribution; • — normal distribution; • — Erlang distribution; ° — Pareto distribution;
• — Cauchy distribution; ° — logistic distribution-1; o — Poisson distribution
To study behavior of the Kalman filter model at different distributions of noise, we developed software that makes it possible to simulate noise exposure that is governed by the examined distributions.
We shall consider work of the scalar Kalman filter algorithm when changing a constant.
Because there is always a single constant, a system's model can be represented in the form:
x, = x, - + w.
(1)
where Xk is the prediction of system state at the current point in time; Xk-1 is the prediction of system state at a preceding point in time; Wk is the control influence.
For a given model, the transfer matrix degenerates to unity, and the control matrix to zero. The measurement model takes the form:
yk = yk-i + vk.
(2)
Pk/(k-1) = P(k-1)/(k-1). + Qk.
(4)
Base on the a priori estimate of state it is possible
to calculate the forecast of measurement:
Once we have the next measurement of magnitude yk, the filter calculates the error of its own prediction for the k-th measurement from expression:
ek = yk y k = yk x(k)/(k-i).
(6)
The filter adjusts its estimation of the state of the system by choosing a point located somewhere between the initial estimate ^Ak)nk-\) and the point that corresponds to the new measurement yk:
k/(k-1) "
*•( k-1)/( k-1)
+ Gkek,
(7)
where Gk is the filter gain coefficient. The estimate of the error variance is also adjusted:
Pk/(k) = (1 Gk )P(k)/(k-i). Thus, variance ek is equal to:
Pk/(k) = P(k)/(k-i) + Rk.
(8)
(9)
The filter gain coefficient at which the minimum error in the estimation of the system's state is reached, is derived from ratio:
Gk = P(k)/(k-1) / Sk.
(10)
In model (2), Vk is an error of measurement, which is characterized by a covariance matrix R, a posteriori matrix P for the accuracy of the estimate obtained and a variance of random process Q.
For model (2), a measurement matrix converts into unity, while covariance matrices P, Q, R transform into variances [20]. At the next k-th step, prior to receiving measurement results, the scalar Kalman filter attempts, in line with formula (1), to estimate the new state of the system:
(3)
Equation (3) shows that the a priori estimate at the next step is equal to the a posteriori estimate performed at the preceding step.
In this case, the a priori estimate of error variance is expressed by:
We shall apply the resulting algorithm to evaluate the effectiveness of the Kalman filtering. Let us consider the work of the Kalman filter to suppress noise with the Pareto distribution. The Pareto distribution is a two-parameter family of absolutely continuous distributions.
The graphical part of evaluating the effectiveness of the Kalman filtering with the Pareto distribution is shown in Fig. 2. The data obtained indicate that the Kalman filter suppresses Pareto noises; a burst at the onset of filter's work is explained by the limited distribution density of the random component [21].
Let us study effectiveness of the Kalman filter to suppress noise with the Cauchy distribution. The graphical part of evaluating the effectiveness of the Kalman filtering with the Cauchy distribution is shown in Fig. 3.
The Kalman filter suppresses Cauchy noises, a burst at the start is due to a random component distribution density.
Filtering efficiency was examined using the developed scalar software implementation of the Kalman filter for two laws of distribution from the left bottom corner in the plane of law distribution based on indicators psi, k (Fig. 1). To draw a final conclusion about the possibility of applying the Kalman filtering to the non- Gaussian noise, we shall investigate the effectiveness of filter application for laws from the upper right corner in the plane of law distribution based on indicators psi, k (Fig. 1).
Let us consider work of the Kalman filter to suppress noise with a normal distribution. The density of a normal distribution is determined from ratio:
exp
f ( x) = -
2\
yk = X(k-1)/(k-1).
(5)
V2P '
The graphical part of evaluating the effectiveness of the Kalman filtering with a normal distribution is shown in Fig. 4.
0.010
20 30 Iteration number a
0.000
10 20 30 Iteration number
b
Fig. 2. Graphical part of evaluating the effectiveness of the Kalman filtering with Pareto distribution:
a — noise suppression errors with Pareto distribution (+ noisy measurements;--a posteriori estimate;
--true value); b — errors in suppressing noise with Pareto distribution
S3
ao
C3
s
-1-
o b
CD
'C o £ a,
0
0.010
0.008
0.006
0.004
0.002
0.000
10 20 30 40 50 0 10 20 30
Iteration number Iteration number
a b
Fig. 3. Graphical part of evaluating the effectiveness of the Kalman filtering with Cauchy distribution:
a — noise suppression errors with Cauchy distribution distribution (+ noisy measurements;--a posteriori estimate;
--true value); b — errors in suppressing noise with Cauchy distribution
10 20 30 40 Iteration number
0.010 0.008
o 0.006
o
S 0.004
a, 0.002
0.000
10 20 30 Iteration number b
Fig. 4. Graphical part of evaluating the effectiveness of the Kalman filtering with a normal distribution:
noise suppression with a normal distribution distribution (+ noisy measurements;--a posteriori estimate;
--true value); b — errors when suppressing noise with a normal distribution
a
a
Let us consider work of the Kalman filter to suppress noise with a logistic distribution. In this case, the density of logistic distribution is derived from ratio:
f(x)=(1 exp(-xV
(1 - exp(-x ))2
The graphical part of evaluating the effectiveness of the Kalman filtering with a logistic distribution is shown in
Fig. 5. The study on the applicability of the Kalman filter in the field of noise with the non-Gaussian distribution suggests that the Gaussian noise distributions are suppressed by the Kalman filter with the same mistake as is the case for noises with Pareto or Cauchy distributions that are far from the Gaussian distribution.
We shall verify the constructed filtering procedure employing data obtained experimentally.
■T
чЗ
s
öS
В
-о
2.5 2.0 1.5 1.0 0.5 0.0
10 20 30 40 Iteration number
a
0.010
ta 0.008
a
I 0.006
SM g
« 0.004
S,
0.002
0.000
10 20 30 Iteration number b
Fig. 5. Graphical part of evaluating the effectiveness of the Kalman filtering with a logistical distribution:
a — noise suppression with a logistical distribution distribution (+ noisy measurements;--a posteriori estimate;
— true value); b — errors when suppressing noise with a logistical distribution
5. Experimental data filtering using the Kalman filter
We used in our research an array of data acquired when controlling weight. The data array is composed of 55 weight measurement values (kg). The measurements were carried out using a specially prepared non-standard weight with a certified weight of 0.175 kg. The measurements were performed using a digital electronic scale with a vibro-frequency mechanical resonator under conditions of vibration and electromagnetic interference, distributed based on an unknown law or the superposition of laws.
y = [0.203, 0.154, 0.172, 0.192, 0.233, 0.181, 0.219, 0.153, 0.168, 0.132, 0.204, 0.165, 0.197, 0.205, 0.143, 0.201, 0.168, 0.147, 0.208, 0.195, 0.153, 0.193, 0.178, 0.162, 0.157, 0.228, 0.219, 0.125, 0.101, 0.211, 0.183, 0.147, 0.145, 0.181, 0.184, 0.139, 0.198, 0.185, 0.202, 0.238, 0.167, 0.204, 0.195, 0.172, 0.196, 0.178, 0.213, 0.175, 0.194, 0.178, 0.135, 0.178, 0.118, 0.186, 0.191].
Let us define the law of distribution of measurement errors in the specified sample; to this end, we map the results of its processing onto the plane of distribution laws in the psi, k coordinates (Fig. 6).
2.00£ 1.75 -
J 1.50
o
£ 1.25 -
<L>
8 l.oo -
% 0.75 "
| 0.50 -0.25" 0.
Fig. 6. A comparative analysis of the distribution laws of experimental data error: • — uniform distribution;
o — logistic distribution; • — normal distribution;
• — Erlang distribution; ° — Pareto distribution;
• — Cauchy distribution; ° — logistic distribution-1;
• — Poisson distribution; • — unknown distribution
A comparative analysis reveals that the experimental sample have an error that is distributed based on the law close to the normal law. Thus, we can apply ratios for the normal distribution to the sample. We shall use the Kalman filter to suppress the normally distributed error of weight measurement (Fig. 7).
0.25
^ 0.20
-P
I 0.15
a
.
C/5
l 0.05
0.00
~0 10 20 30 40 50 Iteration number a
0.010
.
M
.
s-
g
.
•2
.
0 10 20 30 40 50 Iteration number b
Fig. 7. Graphical part of evaluating the effectiveness of the Kalman filtering for experimental data: a — noise distribution (+ noisy measurements; — — a posteriori estimate;
--true value); b — errors in noise suppression
Evaluation results confirm the effectiveness of the use of the developed software implementation of the Kalman filter for experimental data whose distribution is outside the Gaussian field. The a priori estimate for a filtering error when the number of iterations exceeds 30 tends to zero.
0 0.1 0.2 0.3 OA 0.5 0.6 0.7 Coefficients nsi
6. Discussion of results of studying the Kalman filter
9. Conclusions
The constructed serial recursive algorithm of the Kalman Filter to filter the data in the field of noises that differ from the Gaussian distribution computes the forecast for measuring the magnitude with respect to the a priori estimate. A distinctive feature of a given filtering algorithm is the identification of a data measurement error distribution law for the non-Gaussian noises at the first stage.
The suggested technique for the identification of a distribution law makes it possible to use the Kalman filtering algorithm when processing noisy data in the cases when a distribution law is unknown. The identification of a distribution law is carried out by determining the point that corresponds to a given distribution in the (psi, ¿)-plane.
The classic Kalman filter employs the calculated values for mathematical expectations, which serve the optimal estimates for the mean square error criterion. In the case of data filtering in the field of the non-Gaussian noise distribution, the specified characteristics cannot be used, the consequence being the inapplicability of the Kalman filter.
The devised procedure of filtering using the Kalman filter could be used when executing the metrological attestation of measurement instruments under industrial conditions when there may be the noisy measuring information due to various noises, including those that are not governed by the Gaussian distribution law. The filter could be applied when processing the data from control systems over state parameters, implemented on the principle of a magnitude threshold control.
The effectiveness of the developed filtering procedure is confirmed by testing the filter when processing experimental data with different laws of noise distribution. To obtain a generic Kalman filter, it is required to undertake a study aimed at the applicability of the filtering technique for data from aggregate and combined measurements, and to construct a filtering algorithm for the multi-channel Kalman filter.
1. Here we report the development of a filtering procedure using the Kalman filter for the non-Gaussian noise distribution. A special feature of the proposed technique is the procedure for the identification of a distribution law for data measurement errors for the non-Gaussian noises at the first stage.
Through the proposed technique for the identification of a distribution law, it has become possible to use the Kal-man filtering algorithm when processing noisy data in the cases when a distribution law is unknown. The filtering of such noises using the Kalman filter has not been achieved previously.
Its applicability was confirmed for the non-Gaussian distribution of noises, which has significantly expanded the scope of filter application.
2. We have proven the possibility of using the Kalman filter in measurement instruments when processing information that is distorted by interference of different origins and levels. It is established that the developed Kalman filter could work in the field of noise with the non-Gaussian distributions.
The effectiveness of the devised filtering procedure was tested by employing various laws of noise distribution. A special feature of the developed recursive serial algorithm of the Kalman Filter to filter data in the field of the non-Gaussian noise distribution is the absence of a need to determine a priori the statistical characteristics of noise.
3. We have verified the devised Kalman filtering procedure for the experimentally obtained data with respect to the superposition of noise distribution laws.
The developed filtering procedure has proved effective in terms of experimental data. The a priori estimate for a filtering error when the number of iterations exceeds 30 tends to zero.
References
1. Grewal M. S. Kalman Filtering // International Encyclopedia of Statistical Science. 2011. P. 705-708. doi: https://doi.org/ 10.1007/978-3-642-04898-2_321
2. Daum F. Nonlinear filters: beyond the Kalman filter // IEEE Aerospace and Electronic Systems Magazine. 2005. Vol. 20, Issue 8. P. 57-69. doi: https://doi.org/10.1109/maes.2005.1499276
3. Wan E. A., Van Der Merwe R. The unscented Kalman filter for nonlinear estimation // Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373). 2000. doi: https://doi.org/10.1109/ asspcc.2000.882463
4. Application of adaptive Kalman filter technique in initial alignment of inertial navigation system / Su W., Huang C., Liu P., Ma M. // Journal of Chinese Inertial Technology. 2010. Vol. 18, Issue 1. P. 44-47.
5. Babikir A., Mwambi H. Factor Augmented Artificial Neural Network Model // Neural Processing Letters. 2016. Vol. 45, Issue 2. P. 507-521. doi: https://doi.org/10.1007/s11063-016-9538-6
6. Doz C., Giannone D., Reichlin L. A two-step estimator for large approximate dynamic factor models based on Kalman filtering // Journal of Econometrics. 2011. Vol. 164, Issue 1. P. 188-205. doi: https://doi.org/10.1016/j.jeconom.2011.02.012
7. Obidin M. V., Serebrovskiy A. P. Ochistka signala ot shumov s ispol'zovaniem veyvlet preobrazovaniya i fil'tra Kalmana // Informa-cionnye processy. 2013. Vol. 13, Issue 3. P. 198-205.
8. Sarkka S., Nummenmaa A. Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations // IEEE Transactions on Automatic Control. 2009. Vol. 54, Issue 3. P. 596-600. doi: https://doi.org/10.1109/tac.2008.2008348
9. Multi-model information fusion Kalman filtering and white noise deconvolution / Sun X.-J., Gao Y., Deng Z.-L., Li C., Wang J.-W. // Information Fusion. 2010. Vol. 11, Issue 2. P. 163-173. doi: https://doi.org/10.1016/jj.inffus.2009.06.004
10. Nikitin A. P., Chernavskaya O. D., Chernavskii D. S. Pareto distribution in dynamical systems subjected to noise perturbation // Physics of Wave Phenomena. 2009. Vol. 17, Issue 3. P. 207-217. doi: https://doi.org/10.3103/s1541308x09030054
11. Arasaratnam I., Haykin S. Cubature Kalman Filters // IEEE Transactions on Automatic Control. 2009. Vol. 54, Issue 6. P. 1254-1269. doi: https://doi.org/10.1109/tac.2009.2019800
12. Parametric Bayesian Filters for Nonlinear Stochastic Dynamical Systems: A Survey / Stano P., Lendek Z., Braaksma J., Babus-ka R., de Keizer C., den Dekker A. J. // IEEE Transactions on Cybernetics. 2013. Vol. 43, Issue 6. P. 1607-1624. doi: https:// doi.org/10.1109/tsmcc.2012.2230254
13. Gavrilov A. V. Ispol'zovanie fil'tra Kalmana dlya resheniya zadach utochneniya koordinat BPLA // Sovremennye problemy nauki i obrazovaniya. 2015. Issue 1-1. P. 1784.
14. Rudenko E. A. A optimal discrete nonlinear arbitrary-order filter // Journal of Computer and Systems Sciences International. 2010. Vol. 49, Issue 4. P. 548-559. doi: https://doi.org/10.1134/s1064230710040052
15. Kaladze V. A. Fil'truyushchie modeli statisticheskoy dinamiki // Vestnik Voronezhskogo gosudarstvennogo universiteta. Seriya: Sistemniy analiz i informacionnye tekhnologii. 2011. Issue 1. P. 22-28.
16. Wu M., Smyth A. W. Application of the unscented Kalman filter for real-time nonlinear structural system identification // Structural Control and Health Monitoring. 2007. Vol. 14, Issue 7. P. 971-990. doi: https://doi.org/10.1002/stc.186
17. Taranenko Yu. K., Oleynik O. Yu. Model' adaptivnogo fil'tra Kalmana // Tekhnologiya priborostroeniya. 2017. Issue 1. P. 9-11.
18. Cover T. M., Thomas J. A. Elements of information theory. John Wiley & Sons, 2012. 36 p.
19. Rossum G. Yazyk programmirovaniya Python. 2001. 454 p. URL: http://rus-linux.net/MyLDP/BOOKS/python.pdf
20. Degtyarev A. A., Tayl' Sh. Elementy teorii adaptivnogo rasshirennogo fil'tra Kalmana // Preprinty Instituta prikladnoy matematiki im. M. V. Keldysha RAN. 2003. P. 26-36.
21. Chernavskiy D. S., Nikitin A. P., Chernavskaya O. D. O mekhanizmah vozniknoveniya raspredeleniya Pareto v slozhnyh sistemah. Moscow: Fizicheskiy in-t im. P. N. Lebedeva, 2007. 17 p.