Научная статья на тему 'Robust design of suspension system with polynomial chaos expansion and machine learning'

Robust design of suspension system with polynomial chaos expansion and machine learning Текст научной статьи по специальности «Компьютерные и информационные науки»

CC BY
140
48
i Надоели баннеры? Вы всегда можете отключить рекламу.
Ключевые слова
ДОЛГОВЕЧНОСТЬ ШАССИ / АНАЛИЗ ДАННЫХ / МАШИННОЕ ОБУЧЕНИЕ / МНОГОЦЕЛЕВАЯ ОПТИМИЗАЦИЯ / ПОЛИНОМИАЛЬНОЕ ХАОТИЧНОЕ РАСШИРЕНИЕ / НАДЕЖНАЯ КОНСТРУКЦИЯ / CHASSIS DURABILITY / DATA MINING / MACHINE LEARNING / MULTI-OBJECTIVE OPTIMIZATION / POLYNOMIAL CHAOS EXPANSION / ROBUST DESIGN

Аннотация научной статьи по компьютерным и информационным наукам, автор научной работы — Gao H., Jézéque L., Cabrol E., Vitry B.

During the early development of a new vehicle project, the uncertainty of parameters should be taken into consideration because the design may be perturbed due to real components’ complexity and manufacturing tolerances. Thus, the numerical validation of critical suspension specifications, such as durability and ride comfort should be carried out with random factors. In this article a multi-objective optimization methodology is proposed which involves the specification’s robustness as one of the optimization objectives. To predict the output variation from a given set of uncertain-but-bounded parameters proposed by optimization iterations, an adaptive chaos polynomial expansion (PCE) is applied to combine a local design of experiments with global response surfaces. Furthermore, in order to reduce the additional tests required for PCE construction, a machine learning algorithm based on inter-design correlation matrix firstly classifies the current design points through data mining and clustering. Then it learns how to predict the robustness of future optimized solutions with no extra simulations. At the end of the optimization, a Pareto front between specifications and their robustness can be obtained which represents the best compromises among objectives. The optimum set on the front is classified and can serve as a reference for future design. An example of a quarter car model has been tested for which the target is to optimize the global durability based on real road excitations. The statistical distribution of the parameters such as the trajectories and speeds is also taken into account. The result shows the natural incompatibility between the durability of the chassis and the robustness of this durability. Here the term robustness does not mean “strength”, but means that the performance is less sensitive to perturbations. In addition, a stochastic sampling verifies the good robustness prediction of PCE method and machine learning, based on a greatly reduced number of tests. This example demonstrates the effectiveness of the approach, in particular its ability to save computational costs for full vehicle simulation.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Надежная конструкция подвески с полиномиальным хаотичным расширением и машинным обучением

На начальном этапе разработки нового транспортного средства необходимо учитывать момент неопределенности параметров, поскольку конструкционные работы предполагают отклонения, вызванные сложностью изготовления ряда элементов с соблюдением производственных допусков. Поэтому числовая оценка критических характеристик подвески, таких как долговечность и комфортные условия во время движения, должна проводиться с учетом факторов случайности. В статье предлагается применять многоцелевую методологию оптимизации, которая рассматривает надежность спецификации в качестве одной из задач. С целью прогнозирования конечного результата на основании заданного набора неопределенных, но ограниченных параметров, предлагаемых в процессе оптимизационных итераций, используется адаптивное полиномиальное хаотичное расширение для объединения локального проектирования экспериментов и глобальных поверхностей отклика. Кроме того, чтобы уменьшить количество дополнительных тестов, которые необходимы для построения полиномиального хаотичного расширения, используется алгоритм машинного обучения, основанный на межпроектной корреляционной матрице, для проведения классификации текущих проектных точек с помощью интеллектуального анализа данных и кластеризации. Таким образом, появляется возможность прогнозировать надежность разрабатываемых оптимизированных решений без использования дополнительных моделей. По завершении процесса оптимизации может быть получен фронт Парето между спецификациями и их надежностью, который представляет наилучшее компромиссное решение с поставленными целями. Оптимальный набор на данном фронте классифицируется и может являться ориентиром для проектирования. Примером этого может служить тестирование модели автомобиля с целью оптимизации его глобальной долговечности на основе дорожных ситуаций. При этом статистическое распределение параметров, таких как траектории и скорости, тоже принимается во внимание. Результаты исследований показывают несовместимость между долговечностью шасси и надежностью этого параметра. В данном случае термин «надежность» не означает «прочность». В статье этот термин предполагает, что функционирование является менее чувствительным к каким-либо отклонениям. Кроме того, стохастическая выборка подтверждает правильность прогноза надежности методом применения полиномиального хаотичного расширения и машинного обучения, в основе которого лежит значительное уменьшение количества тестов. Показана эффективность предлагаемого подхода, в частности отмечается возможность экономии расчетных затрат на разработку моделей транспортного средства.

Текст научной работы на тему «Robust design of suspension system with polynomial chaos expansion and machine learning»

https://doi.org/10.21122/2227-1031-2020-19-1-43-54 UDC 629

Robust Design of Suspension System

with Polynomial Chaos Expansion and Machine Learning

H. Gao1, 2), L. Jezequel1), E. Cabrol2), B. Vitry2)

1)Ecole Centrale de Lyon (Ecully, French Republic),

2)Renault SAS (Guyancourt, French Republic)

© Белорусский национальный технический университет, 2020 Belarusian National Technical University, 2020

Abstract. During the early development of a new vehicle project, the uncertainty of parameters should be taken into consideration because the design may be perturbed due to real components' complexity and manufacturing tolerances. Thus, the numerical validation of critical suspension specifications, such as durability and ride comfort should be carried out with random factors. In this article a multi-objective optimization methodology is proposed which involves the specification's robustness as one of the optimization objectives. To predict the output variation from a given set of uncertain-but-bounded parameters proposed by optimization iterations, an adaptive chaos polynomial expansion (PCE) is applied to combine a local design of experiments with global response surfaces. Furthermore, in order to reduce the additional tests required for PCE construction, a machine learning algorithm based on inter-design correlation matrix firstly classifies the current design points through data mining and clustering. Then it learns how to predict the robustness of future optimized solutions with no extra simulations. At the end of the optimization, a Pareto front between specifications and their robustness can be obtained which represents the best compromises among objectives. The optimum set on the front is classified and can serve as a reference for future design. An example of a quarter car model has been tested for which the target is to optimize the global durability based on real road excitations. The statistical distribution of the parameters such as the trajectories and speeds is also taken into account. The result shows the natural incompatibility between the durability of the chassis and the robustness of this durability. Here the term robustness does not mean "strength", but means that the performance is less sensitive to perturbations. In addition, a stochastic sampling verifies the good robustness prediction of PCE method and machine learning, based on a greatly reduced number of tests. This example demonstrates the effectiveness of the approach, in particular its ability to save computational costs for full vehicle simulation.

Keywords: chassis durability, data mining, machine learning, multi-objective optimization, polynomial chaos expansion, robust design

For citation: Gao H., Jezequel L., Cabrol E., Vitry B. (2020) Robust Design of Suspension System with Polynomial Chaos Expansion and Machine Learning. Science and Technique. 19 (1), 43-54. https://doi.org/10.21122/2227-1031-2020-19-1-43-54

Надежная конструкция подвески

с полиномиальным хаотичным расширением и машинным обучением

Х. Гао1' 2), Л. Йезеквель1*, Э. Каброль2), Б. Витри2)

^Центральная школа Лиона (Экюли, Французская Республика), 2)Компания «Рено САС» (Гюйанкур, Французская Республика)

Реферат. На начальном этапе разработки нового транспортного средства необходимо учитывать момент неопределенности параметров, поскольку конструкционные работы предполагают отклонения, вызванные сложностью изготовления ряда элементов с соблюдением производственных допусков. Поэтому числовая оценка критических

Адрес для переписки

Гао Ханвэй

Центральная школа Лиона просп. Ги де Коллонг, 36,

69134, г. Экюли Седекс, Французская Республика

Тел.: +33176 85-67-51

hanwei.gao@ec-lyon.fr

Н Наука

итехника. Т. 19, № 1 (2020)

Address for correspondence

Gao Hanwei

Ecole Centrale de Lyon

36 Guy de Collongue Ave.,

69134, Ecully Cedex, French Republic

Tel.: +33176 85-67-51

hanwei.gao@ec-lyon.fr

характеристик подвески, таких как долговечность и комфортные условия во время движения, должна проводиться с учетом факторов случайности. В статье предлагается применять многоцелевую методологию оптимизации, которая рассматривает надежность спецификации в качестве одной из задач. С целью прогнозирования конечного результата на основании заданного набора неопределенных, но ограниченных параметров, предлагаемых в процессе оптимизационных итераций, используется адаптивное полиномиальное хаотичное расширение для объединения локального проектирования экспериментов и глобальных поверхностей отклика. Кроме того, чтобы уменьшить количество дополнительных тестов, которые необходимы для построения полиномиального хаотичного расширения, используется алгоритм машинного обучения, основанный на межпроектной корреляционной матрице, для проведения классификации текущих проектных точек с помощью интеллектуального анализа данных и кластеризации. Таким образом, появляется возможность прогнозировать надежность разрабатываемых оптимизированных решений без использования дополнительных моделей. По завершении процесса оптимизации может быть получен фронт Парето между спецификациями и их надежностью, который представляет наилучшее компромиссное решение с поставленными целями. Оптимальный набор на данном фронте классифицируется и может являться ориентиром для проектирования. Примером этого может служить тестирование модели автомобиля с целью оптимизации его глобальной долговечности на основе дорожных ситуаций. При этом статистическое распределение параметров, таких как траектории и скорости, тоже принимается во внимание. Результаты исследований показывают несовместимость между долговечностью шасси и надежностью этого параметра. В данном случае термин «надежность» не означает «прочность». В статье этот термин предполагает, что функционирование является менее чувствительным к каким-либо отклонениям. Кроме того, стохастическая выборка подтверждает правильность прогноза надежности методом применения полиномиального хаотичного расширения и машинного обучения, в основе которого лежит значительное уменьшение количества тестов. Показана эффективность предлагаемого подхода, в частности отмечается возможность экономии расчетных затрат на разработку моделей транспортного средства.

Ключевые слова: долговечность шасси, анализ данных, машинное обучение, многоцелевая оптимизация, полиномиальное хаотичное расширение, надежная конструкция

Для цитирования: Надежная конструкция подвески с полиномиальным хаотичным расширением и машинным обучением / Х. Гао [и др.] // Наука и техника. 2020. Т. 19, № 1. С. 43-54. https://doi.org/10.21122/2227-1031-2020-19-1-43-54

Introduction

The robustness of vehicle specifications is given more and more attention in Renault because original designs during the development can be perturbed by many uncertain sources: actual road charges, manufacturing tolerances, aging of materials, etc. As a result, sometimes the validation of important specifications such as chassis' durability may take a lot of time and resources to ensure the design is robust enough and can be satisfied all through the vehicle's life cycle [1].

In this paper, the term of robustness is defined as system's ability of tolerating outside perturbations. The robustness is an opposite notion of sensitivity where the least variation of vehicle performance is searched within the random input parameters. Instead of analyzing the impact of each parameter on the final output, the robust optimization focuses on minimizing the overall variations while the statistic characters of input are predefined. Meanwhile, these two notions can easily be transformed after the result of a design of experiments is obtained.

There are several numerical methods to calculate the robustness of one given set of parameters under perturbation.

• Monte-Carlo analysis is to generate random samples in uncertain spaces according to their distributions. The method is easy to integrate and reliable but it requires a huge number of samples to eliminate the random effects of sampling. Other similar methods such as Latin Hypercubic Sampling (LHS) or orthogonal design of experiments are proposed to reduce the total number of tests but are still expensive when the simulation itself is very heavy.

• Min-Max analysis is to run simulations with the combination of upper and lower bounds of uncertain parameter intervals to estimate the worst case under perturbation [1]. It needs less tests compared to random sampling and the result is reasonable as long as the effects of parameters are linear or quasi-linear. However, the statistic characters of the systems cannot be obtained when only the bounds of interval are considered and the robustness estimation may put too much emphasis on the case of which the possibility can be neglect able.

• Analytical methods such as Taylor expansion or direct interval analysis [2] are very efficient because only partial differential equations of the systems are needed instead of a large amount of

Наука

итехника. Т. 19, № 1 (2020)

simulations. However, the mathematical expressions in the industrial problems are difficult to obtain while simplifying a complex system into an academic model may raise the problem of repre-sentativity.

One of the targets during project development is to integrate the robustness into the optimization procedure where the optimum of vehicle specifications and their robustness are searched at the same time. It becomes even more important to reduce the additional simulation number. In this article, an approach based on polynomial chaos expansion (PCE) is applied where only a limited local design of experiments is need for each design point.

The Hermite polynomial chaos was first introduced by Wiener [3] to model stochastic response of a system under Gaussian distributed parameters. Then it has been extended into other type of orthogonal polynomial bases according to different probability distributions [4, 5]. In this study Chebyshev polynomials of the second kind have been applied, which fits better real industrial uncertainties.

The target of polynomial chaos expansion is to establish a relationship between a system output and parameter inputs based on a given series of polynomials. Once the coefficient in front of each polynomial is calculated, system can be described and the robustness can be calculated. For a black box system additional tests are needed in order to decide the maximum order and important interactive terms of polynomials included in this expansion.

This paper proposes a multi-objective optimization plan with the integration of adaptive-sparse polynomial chaos expansions. The polynomial chaos expansion is calculated by a projection method which reuses response surfaces constructed in the optimization process. To further reduce the additional tests, a machine learning algorithm based on data mining is applied to justify by advance the quality of response surface before running the local design of experiments.

Section II of this paper introduces the construction of polynomial chaos expansion as well as its integration into the optimization strategy. In section III a data mining and machine learning algorithm is presented which aims to further reduce sample numbers but keep the accuracy of robust-

■ Наука

итехника. Т. 19, № 1 (2020)

ness prediction. Section IV demonstrates the optimization of a quarter-car example with the proposed approach.

Robust optimization with PCE

Introduction of polynomial chaos expansion and Chebyshev polynomials of the second kind.

An N-dimensional random variable vector x = (x1, x2,..., xn) is considered. For each input variable x, e r,, where r, is a one-dimension random space, its probability density function (PDF) can be defined by (xt). Assuming that all the random variables are independent, the overall PDF P(x) can be defined as

P (x ) = Pi (xi) P2 (x2). Pn (xn)

in r = r^ ...r,. (1)

The system at one set of parameters x an be written as a converged series of polynomial basis

W W n

f (x) =I4 (x)) = sA + H1 ^ (^ (x)) +

i=0 j =1 ii =1

W n .

422 fe (xR (x))+ (2)

j2 =1i1 =1i2 =1 W n ¿1 ¿2

+III I*L 4J fe (x), ^ (x), ^ (x)) +...

Ji =1!1 =1 ¿2 =h3 =1

where ^(x)=fe (x) (x), ^n (x)} - set of

ran-dom variables obtained by normalization of x according to known mean values and the standard deviations; 4J (%(x)) - n-dimension chaos of order j in terms of x).

The inner product of two orthogonal polynomial basis can be expressed as

(4, J = sj(42), (3)

where S. - Kronecker delta, S. = 1 when i = j and S= 0 when i * j.

To simplify the expression, the equation (2) is truncated to maximum order M and it includes only univariate and bivariate terms, which can be rewritten as

M n

f (x) = ф (Ç(x)) = ^ + XEsf (Ь (x)) +

i=0 j =1 z"! =1

M n i

Ф22 fe (x),^ (x)). (4)

j2 =H =1i2 =1

The form of the polynomial basis ^ is defined by the distribution types of random parameters. Chebyshev polynomial of the second kind is applied in this study. As its probability density function corresponded is Wagner semicircle distribution defined in (Fig. 1) [-1.1]. The semicircle law

is more suitable to industry problems where the parameters have more weights around the design values and will never go to infinity. The polynomials can be defined by a recurrence method:

Un+1 () = 2xUn ()- Un_1 (^i), for n > 1

with U0 (^ ) = 1; U (^ ) = . (5)

and ^ e [-1.1],

where ^ - respects a Wagner semicircle distribution.

The distribution function is normalized to make sure the integration in [-1.1] equals to 1, so in fact it becomes a semi ellipse

2 n

The equation (3) can be expressed as for two one-dimension polynomials

w

( ь )=.

(6)

1

(UmUn) = \Um (bi )Un (b" ) w & )dx :

(7)

In equation (4) coefficients s. are unknown and need to be calculated. For a black-box system, two non-intrusive methods exist to calculate s..

• Regression method: the order and the terms of the expansion are assumed a priori. The coefficients are then calculated by linear regression method based on the samples around the reference point. By iterations the algorithm will decide whether to add or remove terms from the expansion until all the important terms are included [6].

• Projection method: an analytical expression has been pre-defined used to represent the blackbox system. Then based on this expression, each coefficient is calculated one by one according to orthogonal projection. Additional samples are also necessary to justify if the expansion order has been converged [7].

In the optimization process expressed in Section III, the analytical expressions for the result outputs have already been calculated. The projection method will be introduced in detail and applied. Another advantage for the projection method is that the accuracy of robustness estimation depends more on the quality of analytical expressions but is less sensitive to the number of samples compared to the regression method.

Assuming fx) is a performance function defined in the design space, one can obtain by multiplying (4) to both sides of (4):

(f ( x )4j ( § ))= I !>i Ф (ЭД (§ )

=

f (x)Ф (§) Фу (§)2

(8)

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

(9)

where (^j (4)2^- constant; (^f (x(4- calculated by multi integration.

Lower tolerance

Design value

> xz

Upper tolerance

+1

Fig. 1. Transformation of a real design parameter to a normalized random variable of Wagner semicircle distribution

Наука

итехника. Т. 19, № 1 (2020)

0

The reference [8] has proposed a decomposition method of f (x) and the numerator of equation (9) can be expanded into univariate and biva-riate terms

-k=

{/(* )Ф (S k)) ф, (s k )2

((i nj (x, ц )ф, (sk)

фу (s k x

-(n - 1) f (ц)(ф, (Sk)))( f (Xk)Ф, (Sk)) ,

sk,l = AJi j

Фу (S k Г

(f ( * )фл, ( sk )) ф, j (sk ,si )2)

; (10)

(S ; =lS j=1f ( Xh' Xh' ) "

;фл ; (sk ,si) -( n - 2 )I If ( x, ц ))фЛ, ( sk ,sl )

(Фл j (sk ,si)

in-1|7-21 f (ц Кфл j (sk ,si)

j (SkЛУ

f (Xk, Xl, Ц,i ) Ф;1 j (Sk,Si ) j (Sk,Si)2

(11)

where sk - coefficient for the / order univariate

j j

polynomial term of £ (xk); sjj - coefficient for the jth order bivariate polynomial term of £ (xk) and £ (xl) (/1th order for £ (xk) and (j - jj)th order for £(xl)); (xt, u,) - vector that replaces all the random variables by its reference value except xi; (x,, x, , u, , ) - vector of reference values exclu-

V '1 '2 r г1,г2 )

ding x,, x,; f (ц)- function value when all the variables are equal to the reference ones.

■ Наука

итехника. Т. 19, № 1 (2020)

It can be noticed that equations (10) and (11) require only one- or two-dimensional integrations. The higher order interaction terms are neglected because of the weak non-linearity in mechanical systems, which saves greatly the computational resources.

One determination coefficient R2 is calculated to justify the correlation between the PCE and test results

R2 (J ) = 1-

Ni и f-(*')-. f (* ))2

11=11 ff (* ) a 1J=1e-t (* )

N'

(12)

where J - order of the PCE; x7 - Ih sample of local experiment design; fest (x1) - test result of this sample.

It can be seen that the quality of prediction is improved with R2 (J) approaching to 1.

When the PCE order is increased by iterations, the PCE is converged if the difference of R2 between two orders is smaller than a threshold s1 which means including new terms has nearly zero impact on the expansion

R2 (J)- R2 (J -1)< s1. (13)

Furthermore, as 2.D-integration is usually more expensive to calculate, another indicator is defined to justify if the bivariate terms of £ (xk) and

£ (x1) for PCE have converged before the total expansion

11 ; ( s (xk. х-, )))2

N

< 82. (14)

If the equation (14) is satisfied it means the contribution of jth order bivariate terms of £ (xk)

and £ (x{) is negligible with respect to the expansion and for the next order this term will not be calculated. A summary of the procedure of calculation of PCE around one reference solution can be seen in Fig. 2.

Once the PCE is constructed, the mean value and standard deviation of f (x) can be estimated by:

M

f (*H f (*)HI- ф

(15)

>

>

>

0

Ч m у

а (f (х ))= ( ф ) = ^. (16)

Л i=i J

РСЕ starts

A given design design point x and a performance funclion/fAV-

i = i + 1

Calculate ith order bivariate coefficients

PCE ends

Fig. 2. Summary of PCE calculation by PCE method for one reference solution

Multi-objective optimization. Chassis systems has multiple demands on durability, ride comfort and handling, etc. while each of them is often incompatible with the others. Therefore, during the design phase, the optimization of chassis system is naturally multi-objective where the best compromises are searched.

The robustness of objectives included in the optimization plan are also integrated and listed as the objectives for optimizing. This step tends to make the objectives even more incompatible because empirically the optimums are less robust compared to the less good solutions. Thus, this study aims to find the relationship between the objectives and their robustness and to propose the optimums which are less sensitive to perturbations.

The mathematical expression of multi-objective optimization can be expressed as:

- minimize:

F(x) = {f (x),f2 (x), ..., fm (x)}; (17)

- under the constraints:

hj (x) = 0, j = 1, ..., q; gk (x)< 0,k = 1, ..., p; (18)

xmin < x < xmax,r = 1,...n,

where x - n x 1 vector of design parameters which forms a design space; xmin, and xmax - lower and upper bounds of the design space; F(x) - m x 1 vector of objective functions for minimizing; hj (x), gk (x) - equality or inequality constraints

of the system.

Instead of summing all the compositions f(x) in F(x), the optimization will treat each objective separately. As a result, the optimization plan will propose a set of compromised optimums instead of only one solution, which will form a Pareto front [1, 9, 10]. The definition of one Pareto optimum is one which is not dominated by any other solutions. There may exist one or more solutions which have better performances in some objectives, but they must have worse solutions in other aspects than those of Pareto optimums.

Another characteristic of industrial problems is that the systems are usually black-box models and the mathematical expression of F(x) does not exist. Therefore, a Meta-model FMeta (x) will be constructed before the optimization iterations begin [11, 12]. FMeta (x) consists of several response surfaces which describe the black-box system with different combination of polynomials. The equation (17) can be replaced by as:

F

1 Meta

( х ) =

{fA (х), fRSi (X)...fRSi (X)}; {Д (х), flRS2 (х)... fR\2 (х)}; { fR0S з ( х ), flRSi ( х )... fRS ( х )}

(19)

where /r!s (х) |( j = 1...li) - /h response surfaces for fi (х) constructed from an initial design of experiments (DOE) in the design space; li - total

Наука

итехника. Т. 19, № 1 (2020)

number of response surfaces configurated for f (x);

fRS (x) - new response surfaces forf (x) who sums

all the response surfaces regarding to their quality by cross validation [13].

The meta-model can then replace the black-box model and be used with the genetic optimization algorithm NSGA-II [14, 15].

For the robustness objectives, the calculation of PCE is based on the Meta-model constructed in this step. As the Meta-model has several expressions to represent the system, several estimations of PCE can also be made. The final robustness is a weighted sum of these estimations according to the quality of response surfaces:

o (f (x))=^- ¿j (fj (x)); (20)

I Is, j

p, =

(l - R2final (j (X)))

(21)

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

where o(fj (x)) - jth PCE robustness estimation for f (x) based on the projection of its jth model

fRjSt ( x ) ; Rfnal (fRS, ( x )) - final determination

coefficient for o(fR,Si (x)) when the PCE is converged to sx (see (13)); p. - weight indicator which judges the quality of ith response surface by comparing it with 1.

The procedure of robust multi-objective optimization is summarized in Fig 4. By iterations, the potential optimums can be proposed by the genetic algorithm based on the objectives' response surfaces. The proposed solutions and their robustness will then be validated by real numerical simulations, of which the results are reused to improve the quality of response surfaces. If the optimization is converged, the solutions proposed will form a Pareto front.

It should be noted that although both the response surfaces and PCEs are in the form of polynomials, the domain of these polynomials are different. For response surface, the variables can cover any values in the design space while for PCE the variables are limited in the neighbourhood of one design value. PCE describes the local behavior

of a specific point on the response surface. That's why the global quality of response surface has a great influence on the robustness estimation.

Application of data mining

and machine learning

The calculation of PCE by projection method requires much fewer tests compared to purely random sampling methods such as Monte-Carlo, which has been shown by the example in Section IV. However, the integration of robustness into the optimization requires hundreds of PCE calculation which is still expensive even if the number of tests required to compute the robustness at one point has been greatly reduced. Two approaches have been applied at the same time to further reduce the number of samples tested for each point.

The first approach is called inherited design of experiments referenced in [13]. The simulations will stock in a data base and be reused in the local DOE for future calculation of PCE if there already exist test results in a new coming point's neighbourhood. With the enrichment of the data base, the extra number of simulations tends to be reduced.

The second approach is to exploit further the data base with a data-mining algorithm and to learn to construct the PCE without extra samples. In the procedure of PCE calculation by projection method in Section II, the local DOE is used to converge the projected terms and orders in PCE by analyzing the quality of approximation between the PCE response surfaces and the simulation results. Unlike the regression method, where the coefficients of polynomials are calculated directly from the DOE results, the projection method depend mostly on the modelling quality of meta-model. If one can predict the weighting factor in equation (20) of each response surface of meta-model on the point to be studied, there will be no need to run extra simulations for PCE calculations.

The data-mining strategy referenced in [10] which is firstly used for post-processing of Pareto front starts firstly by calculating the normalized correlation distances of different information between each pair of design points i and j:

DX = 1 -

k - X j

max ( Xt- -X * , t, * = 1..^)

(22)

■ HayKa

«TexHMKa. T. 19, № 1 (2020)

0

1

df = 1 -

D = 1 -

F1 - F1

max( Ft- - F- , t, - = 1...N)

P1 - P1

max( Pt - P1, t, - = 1

.N )'

(23)

(24)

where Dx, Dj, Dp - distance of input variables,

objectives and weighting factors of design points i and j; N - number of existing simulations in the data base; x' - ith vector of input parameters; Fi - vector of objectives defined in equation (17); P1 - vector of weighting factors calculated when combining the estimations from response surfaces in (21).

According to the definition, the correlation between two designs will be good when D. ^ 1.

The inter-design matrix D x, inter-objective matrix DF and weighting factor matrix D P are symmetric matrix and can be used to analyze the correlation of each pair of points in the data base (Fig. 7, 8). Another mixed matrix M can be defined to show the correlation of both input and output between two designs:

M, =( DX f (DF f;

Cx + CF = I

(25)

where cx, cF - coefficients of mixture defined between 0 and 1.

In order to make the matrix more readable, a bipolarization algorithm cited in [10] will used to arrange the order of design point according to their resemblance level. The algorithm starts with finding the two most different design point in M. and grouping their neighbors based on a resemblance threshold s. This operation is looped for the rest of non-grouped points until all the points are arranged. The algorithm schema is shown in Fig. 3.

An example of the result after bipolarization is shown in Fig 3. It is a process similar to clustering method in data mining which also regroups the existing solutions according to several features (in this study the parameters and objectives). The typologies of the database can be exploited as

a post-processing to find the orientation of multi-objectives in each group. The grouping result will also serve as a base for learning in the next steps.

Bipolarization starts

/ A mixed correlation matrix Mo and an simular threadhold s /

Yes

set m = 0

Mfj ~min{Mm)

> , No

Groupm = find(M™k > s) k = \ ..size(Mm)

m = m + 2

Delete Groupm from M" i :

Groups = find(Mf£ > s)

k = l..size(Mm+[)

I

Mm+2: Delete Groupm+] from Mm

Return Groupt, k = 0...(m + 2)

(^^p|polarizalioii емГ^

Fig. 3. Algorithm schema for bipolarization method of data mining

Fig. 11 shows Dp in the groups obtained

by mixed design-objective matrix M in Fig. 10. It shows that for the resembling design points, the weighting factors tend also to be alike. It is reasonable because the points in the same group also tend to be neighborhood in the meta-model, where the modelling quality of response surfaces is similar in this area. The neighbourhood has been displaced for a different group thus the modelling quality of each response surface has also changed.

Наука

итехника. Т. 19, № 1 (2020)

The principle of learning is that if the new design points of which the robustness is to be calculated fall into one existing group, the quality of estimation of each response surfaces can also be learned based on the Dp information in the group. As a

result, the calculation needs no extra simulation.

The algorithm of learning for a new coming design point can be summarized as following:

1) a new line/column is added into the correlation matrix Dx, DF to make two (n +1)(n +1)

matrix by calculating the correlation distances from the new point to the data base;

2) the minimum correlation distance is to be found between the new point and each existing group. A pre-defined threshold will judge if the new coming point belongs to any group in the data base;

3) if no groups can be referenced. The robustness will be calculated by the local DOE method in Section II. If there exists at least one group that can include the new design point, the vector P of weighting factors can be learned from those in this group. The combined PCE estimation can be obtained without running simulations.

Example with a quarter car model

A quarter car model has been applied to demonstrate the robust multi-objective optimization strategy proposed in this paper. The model has been shown in Fig. 5: m1 - unsprung mass which sums the mass of the wheels and a part of half suspension; m2 - sprung mass of a quarter of the car body; kx, c1 - tire stiffness and damping rate; k2 , c2 - suspension vertical stiffness and damping rate; x0 - coordinate of the road profile; x1, x2 -vertical displacements of the unsprung/sprung masses.

In this example it is assumed that the masses m1, m2 and the properties of tire k1, c1 are given and the target is to optimize the properties of suspension parameters: k2 and c2 . The non-linearity of damping ratio c2 has been considered and thus it consists of four values which define different slopes of force/velocity at high & low velocity and compression & rebound phases (c2i, i = 1...4).

Optimization ends

Fig. 4. Summary of the optimization procedure with the integration of PCE calculation and learning algorithm

■ Наука

итехника. Т. 19, № 1 (2020)

dency of the relationship between the objective and its robustness.

Fig. 5. A quarter car model with its definition of parameters

The objective in optimization is to minimize the equivalent damage force on the m1 when x0 is passing a Belgian blocks test track. The definition of equivalent damage force is based on Basquin fatigue low

Fed = Fm

2 N

(26)

where Fed - equivalent damage force; Fmax - maximum force in Basquin model when total damage D = 1; N - number of cycles corresponding to D = 1; di, ni - cumulative damage and its repetitions in the force signal in the simulation which are obtained by rainflow-counting algorithm; B - constant number of the Basquin model.

The second objective is the robustness of Fed due to the uncertainty added in the system: the variation of k2 and c2i, i = 1...4, to represent manufactory tolerances and aging during usage accompanied with passing velocity and road amplitudes as validation process perturbations.

The non-dominated design points between two objectives are shown in Fig. 6 with the PCE method and learning algorithm. The optimum solutions in durability have relatively worse robustness due to perturbations. Tab. 1 shows the comparison between a much larger sampling size (1000 tests) with Latin Hypercubic method, the local DOE with only 8 tests and learning algorithm without tests for 3 design points. The reference point is the design point when the optimization starts. Optimized point 1 is one of the optimums orientated to robustness and optimized point 2 is one oriented to durability. It can be seen that the PCE method succeeded in produce the closed estimations as ones from a larger sampling especially for the first two points. Estimation for the design points oriented to durability is less good but it still shows the ten-

.Q 0.06

О

a:

0.05

Pareto front alter 2 iteration

---Pareto front alter 6th iteration

_____Pareto frorrt alter 9th iteration

_Pareto fron2 alter 12th iteration

Q.b 0.8 1Q 1.2 1.4 1.b

Normalized Fed

Fig. 6. Evolution of Pareto front between normalized equivalent damage force and its robustness (The damage force of starting point is 1)

Table 1

Comparison of PCE estimations obtained by different methods for 3 points

Rtf. print Opt. print 1 Opt. print 2

k2, N/m 20500 10250 10250

c21, Ns/m 250 790 260

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

c21, Ns/m 2220 4440 1100

c21, Ns/m 2360 4720 1220

c21, Ns/m 2360 4710 1180

Fed, N 2252 2413 1192

PCE by tata miring (0 test), % _ 5.34 8.42

Local DOE (8 tests), % 7.45 5.15 7.39

LHS (1000 tests), % 7.73 5.07 6.56

The matrix of D*, DF, M regrouped M and DP in each group are shown in Fig. 7—11 after 12th iteration. It can be seen that the existing design points can be distributed into several small groups where the weighting vectors tends to resemble each other. This offers a good learning basis for new coming design points.

In this optimization totally 113 potential design optimums of robustness have been proposed during meta-model's construction and optimization iterations, which means millions of simulations of durability objectives need to be run if all the robustness is validated by a Monte-Carlo sampling. The size of one local DOE for PCE calculation is set to 8. If a PCE method without either inherited DOE nor learning method has been applied, about 1000 simulations would need to be run theoretically. With the integration of inherited DOE, the total number of simulations can be reduced to 802.

The learning algorithm permits to reduce further 22 % amount of simulations to 628 and the robust estimation keeps the same level. The gain is encouraging when one single simulation takes a long time.

Наука

итехника. Т. 19, № 1 (2020)

■ ■ "i dii IHI* ■ - ■ IJLJL.AH u.1 . . —1.

ir i r .I S 1_ ..........1,...... _ ^^^ ■ H ■ ■ ■ ■ -i -1—

■ ■ ■ ■ r ■ B_ _ ■

: i

|J |i

ilir ■ -s i ™

5 10 15 20 25 30 35 40 45 50

No. Test (/)

Fig. 8. Inter-objective correlation matrix DF for 91 objective vectors

10 20 30 40

No. Test (/)

Fig. 9. Mixed design-objective matrixMfor Fig. 7, 8 with cx = 0.6, cF = 0.4

20 25 30 35

40 45

No. Test (i)

Fig. 11. Weighting matrix D in the group of Fig. 10 (black lines mean the groups found in M)

Fig. 12 shows the comparison of the Pareto front between a robust optimization with learning and one without learning. It can be seen that there are some local differences between two strategies, but the tendency of durability objective and its robustness are close. Fig. 13 shows the number of design points suitable for learning algorithm and average additional samples for one PCE calculation according the optimization iterations. The curves have oscillated at the beginning and become stable from 7th iteration. Most of design points are groupable from 7th iteration which means the test data base is complete especially at the region close to the Pareto front.

■ HayKa

«TexHMKa. T. 19, № 1 (2020)

10

15

20

25

30

35

40

45

Fig. 12. Comparison of Pareto front between the optimization with or without learning

No. Iteration

Fig. 13. Evolution of number of groupable numbers (in triangles) and additional tests (in circle) per point with iteration

CONCLUSION

In this paper a robust optimization method has been proposed which aims to reduce the number of tests during the optimization and gives a global view on the relationship between the design objectives and their robustness. The integration of a learning algorithm based on data mining permits to further reduce the necessary simulations. The example shows the data mining plan is suitable for small size data bases and once it is constructed the estimation of robustness needs no more simulations.

REFERENCES

1. Chatillon M. M. (2005) Méthodologie de Conception Robuste Appliquée Aux Trains de Véhicules de Tourisme. Doctoral dissertation, Ecully, Ecole Centrale de Lyon.

2. Dessombz O. (2000) Analyse Dynamique de Structures Comportant des Paramètres Incertains. Doctoral Dissertation, Ecully, Ecole Centrale de Lyon.

3. Wiener N. (1938) The Homogeneous Chaos. American Journal of Mathematics, 60 (4), 897-936. https://doi.org/ 10.2307/2371268.

4. Xiu D., Karniadakis G. E. (2002) The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations. SIAM Journal on Scientific Computing, 24 (2), 619-644. https://doi.org/10.1137/s1064827501387826.

5. Wu J., Luo Z., Zhang Y., Zhang N., Chen L. (2013) Interval Uncertain Method for Multibody Mechanical Systems Using Chebyshev Inclusion Functions. International Journal for Numerical Methods in Engineering, 95 (7), 608-630. https://doi.org/10.1002/nme.4525.

6. Kim N. H., Wang H., Queipo N. (2004) Adaptive Reduction of Design Variables Using Global Sensitivity in Reliability-Based Optimization. 10th AIAA/ISSMO Multidis-ciplinary Analysis and Optimization Conferencep, 4515. https://doi.org/10.2514Z6.2004-4515.

7. Hu C., Youn B. D. (2011) Adaptive-Sparse Polynomial Chaos Expansion for Reliability Analysis and Design of Complex Engineering Systems. Structural and Multidiscip-linary Optimization, 43 (3), 419-442. https://doi.org/ 10. 1007/s00158-010-0568-9.

8. Knio O. M., Najm H. N., Ghanem R. G. (2001) A Stochastic Projection Method for Fluid Flow: I. Basic Formulation. Journal of Computational Physics, 173 (2), 481-511. https://doi.org/10.1006/jcph.2001.6889.

9. Eddy J., Lewis K. (2001) Effective Generation of Pareto Sets Using Genetic Programming. Proceedings of DETC '01 ASME 2001 Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Pittsburgh, PA, Sept. 9-12, 2001, 132.

10. Loyer B. (2009) Conception Fonctionnelle Robuste Par Optimisation Multicritère de Systèmes de Suspension Automobile Passifs et Semi-Actifs. Doctoral Dissertation, Ecully, Ecole Centrale de Lyon.

11. Allen T. T., Bernshteyn M. A., Kabiri-Bamoradian K. (2003) Constructing Meta-Models for Computer Experiments. Journal of Quality Technology, 35 (3), 264-274. https://doi.org/10.1080/ 00224065.2003.11980220.

12. Acar E., Rais-Rohani M. (2009) Ensemble of Metamodels with Optimized Weight Factors. Structural and Multidis-ciplinary Optimization, 37 (3), 279-294. https://doi.org/ 10.1007/s00158-008-0230-y.

13. Dumont E., Khaldi M. (2018) Alternova Layer 1 User Guide for Renault. Eurodecision, May.

14. Di Pierro F., Khu S. T., Djordjevic S., Savic D. (2004) A New Genetic Algorithm to Solve Effectively Highly Multi-objective Problems: Poga. Report Nr 2004/02, Center for WaterSystems, University of Exeter.

15. Wang G. G. (2003) Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points. Journal of Mechanical Design, 125 (2), 210-220. https://doi.org/10. 1115/1.1561044.

Received: 08.10.2019 Accepted: 10.12.2019 Published online: 31.01.2020

Наука

итехника. Т. 19, № 1 (2020)

i Надоели баннеры? Вы всегда можете отключить рекламу.