Научная статья на тему 'GLOBAL TRACKS FOR THE STRATEGIC DEVELOPMENT OF WORLD LEADERS IN SCHOOL EDUCATION ON THE EVE OF THE PISA-2022 STUDY'

GLOBAL TRACKS FOR THE STRATEGIC DEVELOPMENT OF WORLD LEADERS IN SCHOOL EDUCATION ON THE EVE OF THE PISA-2022 STUDY Текст научной статьи по специальности «Науки об образовании»

CC BY
15
16
i Надоели баннеры? Вы всегда можете отключить рекламу.
Ключевые слова
SCHOOL EDUCATION SYSTEM / GLOBAL TRACKS OF STRATEGIC DEVELOPMENT / WORLD LEADERS IN EDUCATION / GLOBAL TRENDS IN THE EDUCATION SYSTEM / GLOBAL DIGITALIZATION / DIGITAL TRANSFORMATION

Аннотация научной статьи по наукам об образовании, автор научной работы — Tomyuk Olga N., Diachkova Anna V., Kiseleva Nataliia A., Kamka Svetlana V., Nikolenko Olga I.

Problem and goal. The countries and territories of the world that are leaders in the system of school education form strategic development tracks aimed at the implementation of educational projects focused on the development of the intellectual and creative potential of the individual and its socialization in the context of global digitalization. The aim of the article is to study the global tracks of the strategic development of world leaders in the field of school education in anticipation of the PISA-2022 study. Materials and methods. Empirical research is based on retrospective and prospective analysis. The materials of the study included the summary indicators for reading, mathematical and science literacy from the PISA 2012, 2015, 2018 reports of the OECD countries and their partners in aggregate form, which were compared with the qualitative and quantitative characteristics of the school education systems of the selected countries and territories. Reported indicators were used to compile a hybrid ranking, cross-country comparison and assess the dynamics (growth) for the three periods of PISA surveys. The paper provides a case analysis of the school education systems of countries and territories of world leaders to identify special and general indicators of global tracks of strategic development. Measuring the comparison ratio allows to check the applicability of universal and/or unique indicators of strategic tracks. Results. The hybrid rating indicators according to PISA 2012, 2015, 2018 show positive growth in Macau (China) and Moscow (Russia) in the range of 2-4%; near-zero growth in Singapore and Estonia; negative growth by 2018 in China (Beijing - Shanghai - Jiangsu - Guangdong), Hong Kong (China), Japan, Korea, Chinese Taipei in the range of 4-5%. Indicators of strategic development tracks have been identified: the professional standard of the teacher, the system of teacher growth, the certification of teachers, the assessment of the quality of the teacher's work (attestation), the competence-based approach, the HR service, the digitalization of the educational process (digital competencies), aimed at implementing the main tasks of PISA. Conclusion. The school education system of any country or territory can introduce and implement indicators of the global universal track of strategic development in its system, but it can also develop unique educational projects and programs to improve the quality of education.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Текст научной работы на тему «GLOBAL TRACKS FOR THE STRATEGIC DEVELOPMENT OF WORLD LEADERS IN SCHOOL EDUCATION ON THE EVE OF THE PISA-2022 STUDY»

Перспективы Науки и Образования

Международный электронный научный журнал ISSN 2307-2334 (Онлайн)

Адрес выпуска: https://pnojoumal.wordpress.com/2022-2/22-02/ Дата публикации: 30.04.2022 УДК 371

О. Н. Томюк, А. В. ДьячковА, Н. А. Киселева, С. В. Камка, О. И. НиколЕнко

Глобальные треки стратегического развития мировых лидеров в области школьного образования в преддверии исследования PISA-2022

Проблема и цель. Страны и территории мира, лидирующие в системе школьного образования, формируют стратегические треки развития, направленные на разработку и внедрение образовательных проектов, ориентированных на развитие интеллектуального и творческого потенциала личности и ее социализацию в условиях глобальной цифровизации. Цель исследования - изучить глобальные треки стратегического развития мировых лидеров в области школьного образования в преддверии исследования PISA-2022.

Материалы и методы исследования. Эмпирическое исследование опирается на ретроспективный и перспективный анализ. Материалами исследования послужили суммарные показатели по читательской, математической и естественнонаучной грамотности из отчетов PISA 2012, 2015, 2018 стран блока ОЭСР и их партнеров в агрегированном виде, которые сопоставлялись с качественными и количественными характеристиками систем школьного образования выбранных стран и территорий. Отчетные показатели использовались для составления гибридного рейтинга, межстранового сравнения и оценки динамики (прироста) за три периода опросов PISA. В работе проводится кейс-анализ систем школьного образования стран и территорий мировых лидеров для выявления особенных и общих показателей глобальных треков стратегического развития. Измерение коэффициента сравнения позволяет проверить применимость универсальных и/или уникальных индикаторов стратегии.

Результаты исследования. Показатели гибридного рейтинга по данным PISA 2012, 2015, 2018 демонстрируют положительный прирост в Макао (Китай) и Москве (Россия) в диапазоне 2-4%; почти нулевой прирост в Сингапуре и Эстонии; отрицательный прирост к 2018 г. у Китая (Пекин - Шанхай - Цзянсу -Гуандун), Гон-Конга (Китай), Японии, Кореи, Китайского Тайбея в диапазоне 4-5%. Выделены индикаторы стратегических треков развития: профессиональный стандарт педагога, система учительского роста, сертификация педагогических работников, оценка качества работы учителя (аттестация), компетентностный подход, HR-служба, цифровизация образовательного процесса (цифровые компетенции), направленные на реализацию основных задач PISA.

Заключение. Система школьного образования любой страны или территории может внедрять и реализовывать в своей системе индикаторы глобального универсального трека стратегического развития, но также может разрабатывать уникальные образовательные проекты и программы для повышения качества образования.

Ключевые слова: PISA, система школьного образования, глобальные треки стратегического развития, мировые лидеры в сфере образования, глобальные тренды системы образования, глобальная цифровизация, цифровая трансформация

Ссылка для цитирования:

Томюк О. Н., Дьячкова А. В., Киселева Н. А., Камка С. В., Николенко О. И. Глобальные треки стратегического развития мировых лидеров в области школьного образования в преддверии исследования Р^А-2022 // Перспективы науки и образования. 2022. № 2 (56). С. 20-38. doi: 10.32744^е.2022.2.2

Perspectives of Science & Education

International Scientific Electronic Journal ISSN 2307-2334 (Online)

Available: https://pnojournal.wordpress.com/2022-2/22-02/ Accepted: 16 November 2021 Published: 30 April 2022

O. N. Tomyuk, A. V. Diachkova, N. A. Kiseleva, S. V. Kamka, O. I. Nikolenko

Global tracks for the strategic development of world leaders in school education on the eve of the PISA-2022 study

Problem and goal. The countries and territories of the world that are leaders in the system of school education form strategic development tracks aimed at the implementation of educational projects focused on the development of the intellectual and creative potential of the individual and its socialization in the context of global digitalization. The aim of the article is to study the global tracks of the strategic development of world leaders in the field of school education in anticipation of the PISA-2022 study.

Materials and methods. Empirical research is based on retrospective and prospective analysis. The materials of the study included the summary indicators for reading, mathematical and science literacy from the PISA 2012, 2015, 2018 reports of the OECD countries and their partners in aggregate form, which were compared with the qualitative and quantitative characteristics of the school education systems of the selected countries and territories. Reported indicators were used to compile a hybrid ranking, cross-country comparison and assess the dynamics (growth) for the three periods of PISA surveys. The paper provides a case analysis of the school education systems of countries and territories of world leaders to identify special and general indicators of global tracks of strategic development. Measuring the comparison ratio allows to check the applicability of universal and/or unique indicators of strategic tracks.

Results. The hybrid rating indicators according to PISA 2012, 2015, 2018 show positive growth in Macau (China) and Moscow (Russia) in the range of 2-4%; near-zero growth in Singapore and Estonia; negative growth by 2018 in China (Beijing - Shanghai - Jiangsu - Guangdong), Hong Kong (China), Japan, Korea, Chinese Taipei in the range of 4-5%. Indicators of strategic development tracks have been identified: the professional standard of the teacher, the system of teacher growth, the certification of teachers, the assessment of the quality of the teacher's work (attestation), the competence-based approach, the HR service, the digitalization of the educational process (digital competencies), aimed at implementing the main tasks of PISA.

Conclusion. The school education system of any country or territory can introduce and implement indicators of the global universal track of strategic development in its system, but it can also develop unique educational projects and programs to improve the quality of education.

Keywords: PISA, school education system, global tracks of strategic development, world leaders in education, global trends in the education system, global digitalization, digital transformation

For Reference:

Tomyuk, O. N., Diachkova, A. V., Kiseleva, N. A., Kamka, S. V., & Nikolenko, O. I. (2022). Global tracks for the strategic development of world leaders in school education on the eve of the PISA-2022 study. Perspektivy nauki i obrazovania - Perspectives of Science and Education, 56 (2), 20-38. doi: 10.32744/pse.2022.2.1

Introduction

orld leaders of school education form strategic tracks aimed at the development and implementation of educational projects focused on the growth of the intellectual and creative potential of the individual and their socialization in the

context of global digitalization, pandemic threats and challenges.

The international program PISA (Programme for International Student Assessment) is a unique program aimed at identifying, on the one hand, the level and quality of education in different countries and territories, and, on the other hand, it makes it possible to identify global and strategic tracks for the development of national school education systems.

The PISA program differs from other school quality assessment programs in that it covers a large number of countries and territories of the world; motivated to get education in the near future; systematic and planned, as the participating countries have the opportunity to monitor the dynamics of the success of their achievements in the education.

It is important to note that each time PISA adds an additional research topic to the assessment of the three key types of literacy (reading, mathematics, science). For example, in 2012, financial literacy was also assessed, in 2015 - the ability to solve problems, in 2018 -global competencies, and in 2022 it is planned to study creative thinking and non-standard creative approach schoolchildren in all areas of activity.

Based on the results of the latest study, more precisely the PISA-2018 program, which covered 78 countries and territories, researchers have the opportunity to create new tools for measuring the quality of education in countries around the world, as well as highlight universal and unique strategic tracks for the development of school education in countries.

It should be noted that in assessing trends in school education, one should rely not only on a retrospective analysis, referring to the PISA 2018, 2015 and further early years reports, but it is also important to see the planning horizons of educational systems, which requires an assessment perspective. That is why we think it important to include the intended goals and objectives of PISA-2022 in the analysis.

The 2022 International Study of the Quality of Education is focused on the modern fifteen-year-old teenager and on identifying their well-read, erudition and ability to apply own knowledge in everyday life. Firstly, the upcoming PISA program is designed to identify trends in improving the reading, mathematical and science literacy of modern children from different countries, and, secondly, what a teenagers can do and how he can apply their knowledge gained at school in the financial sector, what their degree of integration into society and the ability to overcome various obstacles in life. The PISA 2022 program tries to reflect not only global trends, trends and new technologies, but also the unique features of a rapidly changing world, highlighting math literacy and math reasoning ability as fundamental literacy. The emergence of new modern technologies is possible with the actively developing mathematical, logical and digital thinking, which are elements of mathematical literacy. Focusing on this, from 2022 PISA will study mathematical reasoning, understood as the ability to reason logically and find objective and persuasive arguments. Here, mathematics is not just a science of abstractions, but also as a science that is applicable in various contexts of real life [1]. In 2022, as part of the international PISA study, a targeted assessment of the frequent use of mathematics in the most important aspects of life: in society, profession and personal life will be carried out.

It should be noted that the importance of the international PISA program is high due to the fact that the countries and territories that participate in the study in the future have the opportunity to study and analyze the results of assessing the quality of school education systems, identify the level, merits and weak elements of their education system, and also to develop an optimal track for the strategic development of the national school system, taking into account both their research results and the identified global trends and trends. Schoolchildren from about 88 countries and territories will show their skills and abilities in the PISA-2022 analysis,

Thus, for more than 20 years, the PISA program has not only become an important global event in the field of education, but more importantly, a kind of beacon for the development of school education in different countries of the world.

The aim of the article is to study the global tracks of the strategic development of world leaders in the school education in anticipation of the PISA-2022 study.

For our study, we will work out the Rankings of countries and territories of world leaders according to PISA 2018, which will allow to closely identify and analyze the global tracks of the strategic development of school education in high-ranking countries and territories, to reveal the universal and distinctive features of education systems, taking into account new trends and tendencies in the context of global digitalization.

Materials and methods

Scientific research is empirical in nature and is based on general and particular scientific methods. A variety of research approaches is associated with the analysis of the international PISA program, which is aimed at assessing the quality of school education in different countries and territories. The research methodology is represented by a set of methods, such as systematization, comparison, generalization, interpretation and analysis of the results of the PISA study.

Empirical research is based on retrospective and prospective analysis. The materials of the study were the summary indicators for reading, mathematical and science literacy from the reports PISA-2012, 2015, 2018 of the OECD countries and their partners in aggregate form, which were compared with the qualitative and quantitative characteristics of the school education systems of the selected countries and territories. Reported indicators were used to compose a hybrid ranking, cross-country comparison and assess the dynamics (growth) for the three periods of PISA surveys. The article provides a case analysis of the school education systems of world leaders to identify special and general indicators of global tracks of strategic development. Measuring the comparison ratio allows you to check the applicability of universal and/or unique strategy indicators. The empirical part of the article consists of four steps.

At the first stage, we choose descriptive quantitative data of the Report PISA-2018 and make TOP-10 hybrid rating of all participating countries and territories.

At the second stage, we studied the dynamics of the indicators of high-ranking countries and territories in the PISA 2012, 2015, 2018 studies, which made it possible to identify the direction of the trends: negative, stable and positive.

At the third stage, indicators of the strategic development tracks of school education in high-ranking countries and territories were identified in accordance with the hybrid rating allocated according to PISA reports. Taking into account the peculiarities of the functioning

of each system of school education universal and special indicators were recorded that affect the results of a high assessment of the quality of school education.

At the fourth stage a special case analysis of school education assessment is presented, covering a comparison of key indicators in accordance with PISA for Moscow and Russia as a whole. On the basis of this, the competitive advantages of Moscow in the strategic development of its concept of the school education system are identified by a set of indicators.

An empirical scientific study makes it possible to identify global tracks of the strategic development of world leaders in the field of school education in accordance with the PISA concept, to identify universal and unique directions in the development of school education in the leading countries of the world among the selected tracks for the formation of a predictive model.

Literature review

The international program for assessing educational achievements among students PISA has established itself as a serious tool for analyzing the quality of the school education system in various countries of the world. The significance of the international PISA program is high, especially among the countries and territories that participate in the study: 2000 - 32 countries, 2003 - 43 countries, 2006 - 57 countries, 2009 - 74 countries, 2012 - 65 countries, 2015 - 70 countries, 2018 - 78 countries, 2022 - 88 countries planned. Project participants can study and analyze not only their results of assessing the quality of school education systems, i.e., identify their levels, advantages and disadvantages, but also develop strategic development directions for themselves. Developing for more than 20 years the PISA program contributes to a critical analysis of the country of its school education system. Acting as a "bifurcation point" They can indicate new trends and based on the results of the study reach a higher level of a national school system. PISA research is an important world event in the school education. Rissom H. W. believes that the initiative of the Organization for Economic Cooperation and Development which in collaboration with scientific organizations and national centers conducts PISA research deserves not only encouragement, but also full support from the state authorities of the countries participating in the international program [2].

Rowley K. J., McNeill S. M., Dufur M. J., Edmunds Ch., Jarvis J. A. analyze how countries are trying to improve their Program for International Student Assessment (PISA) rankings and scores based on PISA 2006, 2009 and 2012 data. As a result, the authors found that few countries significantly increased their PISA scores. At the same time, improvements in PISA scores are observed in those whose rating was significantly lower in the previous study period, and who adapted the national school system in the context of PISA objectives [3].

Scientists Haw J. Y., King R. B., Trinidad J. E. R. studying the school education in many countries draw attention to the fact that the experience of world leaders in school education has a positive effect and improves the education quality in other countries [4]. Kaplan D., Jude N. studied how countries used global trend analysis to inform national education policy. The authors emphasize the importance of predictive models based on international large-scale PISA estimates [5].

Mazurek J., Garcia C. F., Rico C. P. argue that student achievement increases the potential of human capital and competitiveness, leading to a balance in solving the problem of gender inequality [6].

The international PISA program affects the improvement of school education quality systems in different countries of the world and thus motivates both teachers and students to develop not only in three types of literacy. Research indirectly forms the image of a successful and effective person who can easily cope with any life problems that occur in society or on a personal and professional level. Of course, Gamasa A., Martinez-Abad F. argue that the PISA reports contain a colossal array of data and in order to be easy to use and quickly obtain the necessary information, for example, based on the results of one's own or another country for the development and formation new development strategy, it is necessary to create a database using intellectual analysis [7]. You can also use the results of PISA reports, both to evaluate special and unique moments in school systems [8], and to assess the quality of education in different countries of the world [9]. A database with intelligent functions for analyzing and evaluating PISA results can better influence the development of school education around the world as well as find more understanding in the scientific literature.

The study by Lavonen J. et al. on the evaluation of a funded and implemented teacher training project in Finland should be highlighted. Such qualities as purposefulness, active learning, cooperation, contextualization and reflection, according to the authors, are significant in the educational process for both students and teachers [10].

Scientists believe that education is endowed with the value of motivation, the value of the desire to receive another education in the future, and the value of employment [11]. PISA research motivates students and educators to continuously improve their education and qualifications. Hori R. & Fujii M. are based on the idea that PISA studies even more actualize the importance of achieving one of the goals of sustainable development about the quality of education, which cannot be imagined in the era of global digitalization and digital transformation without free possession of IT technologies. Digital literacy provides an opportunity to be more confident, efficient, successful [12]. Kyzym M., Balian A. et al. once again confirm the idea in their work that the competent use of new digital technologies, on the one hand, affects the increase in human, social and financial capital, and, on the other hand, can lead to digital inequality [13]. Only global digitalization and high-quality digital transformation will provide a digital educational environment that will motivate, stimulate and increase the desire for conscious study of educational content [14].

In the context of the promising task of our study, it is necessary to point out the work of Marouli S., which convincingly proves the need for an education system for sustainable development (ESD). The author points to the improvement of the education system, taking into account the current socio-economic and cultural context. Education not just for society, but rather for eco-communities, suited to the challenges of the 21st century [15].

On the eve of the PISA-2022 study, the participating countries are studying not only global trends and trends in the school education system of world leaders, but also forming their own strategic development track. The modern world is changing rapidly, new conditions and trends are emerging. So, it is necessary to constantly adapt the education in general and school education in particular to achieve high-quality results in solving problems in the world and society, at the personal and professional levels.

Results

As part of a scientific study, the results of PISA-2018 on assessing the quality of school education were studied and rankings of world leaders of countries and territories in the

field of school education were compiled, united in three groups: 1) OECD countries, 2) OECD partner countries and territories, and 3) all countries and territories participating in this program in 2018.

The ratings are arranged in descending order of indicators, which are based on the sum of points for three types of literacy: reading, mathematical and sciences. In this empirical study, when forming the rankings of world leaders in the school education system, we focused not only on the countries of the Organization for Economic Cooperation and Development (hereinafter referred to as the OECD) and the countries of the OECD partners according to PISA-2018, but also on the territories of the OECD countries and OECD partner countries that are represented in the PISA surveys (see Table 1). It was important for us to identify and study the global tracks of the strategic development of world leaders in the field of school education in order to comprehend the high results of assessing the quality of education in these countries and territories. It is necessary to reveal the universal and unique features of strategic development tracks, scenarios for successful strategies for the development of school education from world leaders in this field.

Table 1

Ranking of world leaders in school education, PISA-2018

Rank OECD partners OECD countries Hybrid group

Country /territory Total scores Country Total scores Country /territory Total scores

Moscow (Russia) 1596

1 China (Beijing - Shanghai -Jiangsu - Guangdong) 1736 Estonia 1576 China (Beijing - Shanghai -Jiangsu - Guangdong) 1736

2 Singapore 1669 Japan 1560 Singapore 1669

3 Macau (China) 1627 Korea 1559 Macau (China) 1627

4 Moscow, Russia) 1596 Canada 1550 Moscow, Russia) 1596

5 Hong Kong (China) 1592 Finland 1549 Hong Kong (China) 1592

6 Chinese Taipei 1550 Poland 1539 Estonia 1576

7 Croatia 1415 Ireland 1514 Japan 1560

8 Russia 1445 Great Britain 1511 Korea 1559

9 Belarus 1417 New Zealand 1508 Chinese Taipei 1550

10 Ukraine 1388 Sweden 1507 Canada 1550

In Table 1, three ratings are arranged in parallel in descending order of indicators, taking into account Total scores in reading, mathematics and science literacy: TOP-10 Ranking of countries and territories of the OECD partners, TOP-10 Ranking of OECD countries and TOP-10 Hybrid ranking of countries and territories according to PISA-2018.

In the TOP-10 of the Ranking of countries and territories of the OECD partners, four positions were taken by China with the territories: Beijing - Shanghai - Jiangsu - Guangdong, Macau, Hong Kong, Chinese Taipei and Russia is presented in two forms (the country as a whole and a separate territory - Moscow). Moscow demonstrates higher quality education and higher results in the PISA-2018 survey than the results for Russia as a whole.

The TOP-10 of the OECD Country Rating included 6 European countries, and the first place in this rating was taken by Estonia, which scored 1576 points. It is important to note that Russia is not among the countries of the Organization for Economic Cooperation and Development

(OECD), therefore Moscow (Russia), as the leading territory in terms of the quality of school education, demonstrated high results in the quality of education, scored a total of 1596 points in reading, mathematics and science literacy, but was not included in the OECD Country Rating and failed to take first place in the TOP-10 OECD Country and Territory Rating.

The TOP 10 of the PISA-2018 Hybrid Ranking is built on the basis of two ratings: the TOP 10 Ranking of Countries and Territories of the OECD Partners and the TOP 10 Ranking of the OECD Countries. The Hybrid Ranking includes ten high-ranking countries and territories of the world with the best school education systems, among them four positions in the ranking were occupied by China with the following territories: Beijing - Shanghai - Jiangsu -Guangdong, Macau, Hong Kong, Chinese Taipei. In the TOP-10 of the hybrid rating, Moscow, as a territory of Russia, took 4th place, losing ground to two Chinese territories (Beijing -Shanghai - Jiangsu - Guangdong, Macau) and Singapore.

The international PISA program and the results of the 2018 study, on the eve of a new study in 2022, have become the main tool for measuring the quality of education in the countries of the world and forming universal and unique strategic tracks for the development of school education in different countries and territories.

When identifying the global tracks of the strategic development of school education in world leaders, it is important to analyze the dynamics of the indicators of countries and territories according to PISA in the studies of 2012, 2015, 2018, which demonstrates a negative, stable or positive dynamic of the indicators of countries and territories in the field of education (see. Fig. 1-3) [16; 17; 18].

1333

Ukraine

| 1417

Belarus

1445

Russia 1476

1443

1415

Croatia 1426

1447

1550

Chinese Taipei 1571

1606 1552

Hong Kong (China) 1631

1661

1596

Moscow, Rus-sia) 1569

1627

Macau (China) 15B2

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

156B

1669

Singapore 1655

1666

1736

Chins (Beijing - Shanghai-Jiangsu - Guangdong) _1543

O 200 400 600 BOO 1000 1200 1400 1600 1300 2000

■ 2013 ■ 2015 12012 Figure 1 Dynamics of indicators in the Ranking of countries and territories of the OECD

partners, PISA 2012, 2015, 2018

The dynamics of indicators in the Ranking (see Figure 1) clearly demonstrates the following trends: negative dynamics - China (Beijing - Shanghai - Jiangsu - Guangdong), Hong Kong (China), Chinese Taipei, Croatia; stable dynamics - Singapore and Russia (in general); positive dynamics - Macau (China), Moscow (Russia). It is important to note that in 2018 Belarus and Ukraine took part in the PISA surveys for the first time and, according to the results of the assessment of the quality of school education, they entered the TOP-10 of the Ranking of countries and territories of the OECD partners, where they took the ninth and tenth places, respectively.

1507

Sweden 1487

1446

| 1508

New Zealand 1517

1528

| 1511

G reat Br itai n _1499

1507 1514

Ireland 1523

| 1546 1539

Roland _1511_

156Z 1549

F ii land 1568

1588

| 1550

Canada 1571

1566

1559

Korea 1557

| 1550

Japan _ 1586

1623

1621

| 1576

Elton ia 1573

1578

^B 1595

Mojcow 1569

1350 14*50 1450 1500 1550 1600 1650

■ 2018 ■ 2015 ■ 2012 Figure 2 Dynamics of indicators in the OECD Country Ranking, PISA 2012, 2015, 2018

The dynamics of indicators in the Ranking of OECD countries (PISA 2012, 2015, 2018) in Figure 2 reflects the following dynamics: negative - Japan, Canada, Finland, Poland, Ireland, New Zealand; stable - Estonia, Korea; positive dynamics - Great Britain, Switzerland. The first place in the OECD Country Rankings (PISA-2018) is occupied by Estonia with a total score of 1576 points in three types of literacy with its unique school system. On the histogram, we indicated the territory - Moscow, taking into account its dynamics of indicators, how the OECD Countries and Territories Rating could look like if Russia was a member of the Organization for Economic Cooperation and Development. As part of the PISA-2018 study, Moscow scored 1596 points and showed the best results in assessing the quality of school education.

Canada Chinese Taipei Korea Japan Eston ia

Hong Kong (China) Moscow, Russia) Macau (China) Singapore

China (Beijing- Shanghai - Jiangsu -Guangdong)

1400 1 450 1500 1550 1600 1650 1700 1750 1000 ■ 2013 ■ 2015 ■ 2012

Figure 3 Dynamics of indicators in the Hybrid ranking of countries and territories

in the study PISA 2012, 2015, 2018

In the hybrid rating, ten high-ranking countries and territories of the world with the best school education systems of PISA-2018 were selected, those that maximally reveal the trends and tendencies of the education system in the context of global digitalization were identified. The dynamics of indicators in the Hybrid ranking (PISA 2012, 2015, 2018) in Figure 3 indicates the following development of school education in countries and territories: positive growth in Macao (China) and Moscow (Russia) in the range of 2-4%; near-zero growth in Singapore and Estonia; negative growth by 2018 in China (Beijing - Shanghai - Jiangsu - Guangdong), Hong Kong (China), Japan, Korea, Chinese Taipei in the range of 4-5%. The first place by a wide margin in the Hybrid ranking of countries and territories (PISA-2018) is occupied by China (Beijing - Shanghai - Jiangsu -Guangdong) with a total score in three types of literacy - 1736 points with its unique school education system.

By studying the global strategic development tracks of highly ranked countries and territories that are in the T0P-20 of the PISA-2018 Hybrid Ranking, using a geographical approach, one can analyze the location of countries, their unique or universal policies in the field of school education.

Table 2

Dynamics of indicators in the Hybrid ranking in the PISA study 2012, 2015, 2018:

geographical approach

Country / territory Total scores

2012 2015 2018

Asia-Pacific group

China (Beijing - Shanghai - Jiangsu - Guangdong) 1763 1543 1736

Singapore 1666 1655 1669

Macau (China) 1568 1582 1627

Hong Kong (China) 1661 1631 1592

Japan 1621 1586 1560

Korea 1628 1557 1559

Chinese Taipei 1606 1571 1550

New Zealand 1528 1517 1508

Europe

Moscow (Russia) - 1569 1596

Estonia 1578 1573 1576

Finland 1588 1568 1549

Poland 1562 1511 1539

Ireland 1546 1528 1514

Great Britain 1507 1499 1511

Sweden 1446 1487 1507

Croatia 1447 1426 1415

Belarus - - 1417

Ukraine - - 1388

North America

Canada 1566 1571 1550

Europe and Asia

Russia 1443 1476 1445

In Table 2, the countries and territories that are in the TOP-20 of the Hybrid Rating are located in terms of geographical approach: Asia-Pacific group - 5 countries and 3 territories, Europe - 9 countries and a territory, North America - a country, Europe-Asia - a country. Based on the geographic view we can conclude that the countries and territories of Europe and the Asia-Pacific group are constantly improving the school education system, carrying out school reforms, forming a new development strategy, developing and implementing educational projects focused on the development of the intellectual and creative potential of the individual and its socialization in the context of digital transformation, pandemic threats and challenges.

According to the PISA-2018, we have revealed universal indicators of strategic development tracks in the school education system of the world leaders: the professional standard of the teacher, the system of teacher growth, the certification of teachers, the assessment of the quality of the teacher's work (attestation), the competence-based approach, the HR service, the digitalization of the educational process (digital competencies), and many others.

Figure 4 Architecture of the model of school education based on the Hybrid ranking

of countries and territories PISA-2018

Studying the global tracks of the strategic development of school education in world leaders in anticipation of the PISA-2022 study we developed the architecture of the school education model based on the PISA-2018 Hybrid Ranking, based on our two studies: the first study is devoted to global trends in the education system of high-ranking countries according to PISA-2018; the second study (described in this article) on the global strategic development tracks of school education of world leaders in the run-up to the PISA-2022 study (see Fig. 4). The model of school education based on the Hybrid Rating of Countries and Territories PISA-2018 includes not only global trends in school education, but also universal and unique indicators that make up the global tracks of the strategic development of school education by world leaders according to the PISA-2018 study.

Let us single out a number of universal indicators of global tracks of the strategic development of school education by world leaders according to the PISA-2018 Hybrid Ranking, and briefly describe these indicators:

• the professional standard of a teacher is a fundamental document that includes the personal and professional competencies of a teacher. Based on the professional standard of a teacher, attestation can be carried out and a qualification category can be assigned;

• the system of teacher growth, on the one hand, is a form of development of teaching staff under the condition of self-regulation, and, on the other hand, a mechanism for professional growth throughout the entire career;

• certification is a procedure by which a teacher confirms his level of competence and qualifications according to the relevant requirements, depending on the position and qualifications;

• assessment of the quality of a teacher's work is a system of performance criteria, which is aimed at identifying the quality of the results of a teacher's professional activity;

• attestation is a process of confirming qualifications, the level of knowledge and skills of a teacher;

• a competence-based approach for teachers and students is a system that creates conditions for mastering a set of competencies that contribute both to the formation of a personality and the ability to adapt to various modern conditions;

• HR service is a service that selects new employees, works with personnel. The HR service does not just hire people to the company, but also involves, motivates, and develops new employees in the workflow;

• digitalization of the educational process is the transformation of familiar processes, for example, from offline to online mode, as well as the development and implementation of new programs, systems, databases, services to optimize the process without losing the quality of the result.

School education of countries and territories can fully include all universal indicators in the track of their strategic development and demonstrate the high quality of school education, while unique indicators may be fully present / absent in the school education development strategy, but the quality of education may be higher than in other countries and territories participating in the research of the international PISA program. Any even universal indicators of the tracks of the strategic development of school education in a particular country can be developed and implemented taking into account unique features, approaches and peculiarities.

Exploring the strategic tracks for the development of school education in countries and territories that are in the TOP-10 of the Hybrid Rating according to the results of the PISA-2018 study. The unique indicators of the track of the strategic development of school education are fully or partially implemented with a slight deviation from the model in all countries and territories of the TOP-10 of the Hybrid Rating according to the PISA-2018 concept.

To describe the characteristics of the school education model based on the PISA-2018 Hybrid Rating of Countries and Territories, which is based on global education trends in accordance with the PISA concept, it is useful to refer to the example of Moscow in comparison with the indicators for Russia as a whole (see Table 3).

Table 3

Comparative characteristics of Moscow and Russia by indicators PISA [19; 20; 21]

Comparison criteria Moscow Russia Comparison ratio

PISA-2018

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

Number of subjects of the Russian Federation 1 43 x

Number of schools (sample) 151 265 x

Number of students 7289 7608 x

Total score 1596 1445 1.104

Reading literacy 534 479 1.115

Mathematical Literacy 534 488 1.094

Science Literacy 528 478 1.105

Критерии сравнения Moscow Russia Comparison ratio

PISA for schools 2016 PISA-2015

Number of subjects of the Russian Federation 1 42 x

Number of schools (sample) 609 210 x

Number of students 42000 6036 x

Total score 1569 1476 1.063

Reading literacy 519 495 1.048

Mathematical Literacy 531 494 1.075

Science Literacy 519 487 1.066

The track for the strategic development of school education in Moscow is built not only on universal, but also on unique indicators. They include the school of steps, pre-profile education along verticals, tutoring, the Olympiad movement, support for talented youth, the personnel reserve program, new formats for improving the qualifications of teachers etc. It should be noted that the Moscow school education system is constantly in a dynamic state, in search for new answers to internal and external challenges. For example, this is being implemented in new educational programs and projects that correspond not only to the conditions of global digitalization, pandemic threats, global trends and trends in education, but also to other modern challenges.

Let's take a few examples to illustrate. Moscow in its school education strategy is developing new programs and projects that are aimed at improving the entire school education system and have a positive effect on improving the quality of education. For example, Moscow schools are updating infrastructure, introducing a digital environment into educational and extracurricular processes. They are also equipped with high-speed Internet access using Wi-Fi and platforms for teaching modern information technologies. The Moscow Electronic School project provided students with the content necessary to prepare for lessons (about 39.000 curricula, 1.500 textbooks and teaching aids, 82.000 interactive educational applications) [22]. Digital today is a tool that allows you to make the educational process as transparent as possible. The digital project "Moscow Electronic School" is, on the one hand, an internal analytics system, and, on the other hand, a crowd technology that allows professionally developing a teacher in the context of digital transformation and pandemic threats. In the 21st century a modern teacher is required to possess digital skills and constantly develop their digital competencies in order to organize better educational and extracurricular processes. The individual path of the teacher's professional development can be built using digital technologies by evaluating the results of the student and analyzing the work of the teacher.

Studying the unique indicators of the track of the strategic development of the Moscow school system, one cannot ignore the concept of the school of growing up. It is organized in accordance with the psychological characteristics, needs and prospects of each age period, and is maximally focused on training to the practice-oriented application of the acquired knowledge and is carried out in different complexes according to the age characteristics of the students. Such an organization of school education confirms the effectiveness of the chosen development strategy and the accents placed in the

system of Moscow education. The School of Growth develops pre-vocational education in high school in nine areas: engineering, IT, academic, entrepreneurial, media, creative industries, cadet and sports. At the moment, more than 50% of high school students are studying in classes with a pre-professional practice-oriented bias using project activities. The School of Growing up is a unique indicator of the track of the strategic development of the Moscow school education system as a practice-oriented collaboration of basic and additional education, pre-professional development of a student that influences his professional choice in the future.

Table 4

Checkpoints of the school education system in accordance with the concept PISA [23; 24; 25]

Criteria PISA research

2012 2015 2018 2022

General purpose To study whether 15-year-old students who have received compulsory general education have the knowledge and skills necessary for full-fledged functioning in modern society, that is, for solving a wide range of tasks in various areas of human activity, communication and social relations. The program allows you to identify and compare the changes taking place in the education systems of different countries and evaluate the effectiveness of strategic decisions in the field of education

Key areas of study Reading literacy

Mathematical Literacy

Science literacy

Main line of research Mathematical Literacy Science literacy Reading literacy Mathematical Literacy

Additional Research Topic Financial literacy Ability to solve problems Global competencies Creative thinking and out-of-the-box creativity in all areas

Innovation purpose Identification of trends in the development of mathematical education in the world in recent years Identification of trends in the development of natural science education in the world in recent years Assessment of reading skills, including the search, selection, interpretation, integration and evaluation of information from sources of various types associated with situations that go beyond the classroom How effectively do countries' educational systems prepare students for the use of mathematics in all aspects of their personal, social and professional lives

- Assessment of reading electronic texts, solving interactive problems during computer testing, assessment of the formation of educational strategies. - Political goal: assessment of the quality and effectiveness of education, equality of access to education - Measuring computer-based literacy using a new type of interactive science literacy task. - Use of cooperative-interactive tasks Evaluation of reading activity (new cognitive strategies) using information from various fields of knowledge, such as science and mathematics, and be able to use technologies to efficiently search, filter and organize a big massive of information 21st century skills: - critical thinking; - creativity; - research and study; - self-regulation, initiative and perseverance; - use of information; - systems thinking; - communication; - reflection

As a result of the study, we fix the fact that in the process of forming, creating, adjusting, adapting the strategy for the development of the school education system in a particular country or territory, it is necessary to take into account not only the results of assessing the quality of education from previous studies of the international PISA program, but also the control points described in this program in the following form: the general goal of the PISA program, key areas of research, main direction of research, additional research topic, innovative goals (for more details, see Table 4). The PISA program develops new test items each time and for each year of the study selects one of the three literacies in the form of functional (core, main) literacy and a unique additional research topic, which allow you to study and objectively assess the quality of school education in countries and territories from a new perspective, participating in the program. In connection with this approach, the results of assessing the quality of school education in countries around the world may change. The PISA program from a certain position in the last ten years has become an international program that motivates countries to modify their tracks for the strategic development of school education to introduce and develop universal and unique indicators.

Discussion

Our study, aimed at studying the global tracks of the strategic development of world leaders in the field of school education in anticipation of the PISA program in 2022, was based on a retrospective and prospective analysis of reports. Using this approach, we support the ideas and results of the study by Kaplan D., Jude N., who pointed out the importance of predictive models for national education systems, which are based on international large-scale assessments [5].

Any strategy for the development of education in general and school education in particular should take into account a favorable, emotional climate among teachers, teachers and students, teachers and parents, etc. A favorable climate is an important factor in cognitive, psychological and social well-being for all participants in the educational and extracurricular processes, but also the entire educational space [26]. We agree with the position of Eryilmaz N., Sandoval-Hernandez A., that the strategy for the development of school education should include a direction that is focused on the sustainability of the modern educational space, the formation of a social climate and the development of emotional intelligence. All this once again confirms our ideas that global trends and trends in the school education system form an effective, successful educational practice [27].

The conclusions of our study are consistent with the approach and results of the study by Rowley K. J. et al., who provide a comparative analysis of countries according to PISA in a retrospective analysis [3].

Based on the perspective of the PISA study planned for 2022 and highlighting the key milestones that are announced in this project, we consider it appropriate to suggest that the organizers of the study include tasks that also aim to test legal, financial and media literacy. These types of literacy play a practical role, demonstrating the ability of students to safely, to some extent independently behave in practical situations in the current conditions of global digitalization and digital innovations. Here we support the idea of Marouli S. about the need to build an education system for sustainable development (ESD) [15].

As a result of the study, we note that the identification of universal and unique indicators applicable for the strategic development of the school educational system

of world leaders according to the PISA-2018 Hybrid Rating of Countries and Territories, where the presence of indicators is an important attribute of the development of the modern educational world space.

Conclusion

The upcoming international PISA research in 2022, aimed at studying the quality of school education in about 88 countries and territories of the world, the fundamental focus of the control points is the assessment of mathematical literacy, mathematical reasoning, creative thinking and non-standard creative approach. The new results of the PISA survey provide monitoring of the country's ranking, the strengths and weaknesses of school education in the participating countries. This, in turn, helps to identify new global trends and trends in the school education system in high-ranking participating countries. This study continues our study "Global Trends in the Education System of High-ranking Countries According to PISA-2018" in the journal Science and Education Perspectives (Issue 1, 2022), where we identified global trends and trends in school education according to PISA-2018. As a result of a new study, we found that, by analyzing the quality of school education systems, countries around the world are not only trying to introduce and begin to implement new trends and trends in the field of education, but also to form, adapt tracks of their strategic development in the field of school education to new modern conditions.

The strategic tracks for the development of school education in world leaders are focused not only on the professional standard of the teacher, the system of teacher growth, but also on the development and implementation of educational projects aimed at developing the intellectual, creative potential of the individual, its socialization in modern conditions of digital transformation and pandemic threats.

According to the PISA-2018 version we have revealed universal indicators of strategic development tracks in the school education system of the world leaders: the professional standard of the teacher, the system of teacher growth, the certification of teachers, the assessment of the quality of the teacher's work (attestation), the competence-based approach, the HR service, the digitalization of the educational process (digital competencies). The world leaders in the school education system according to PISA-2018, on the one hand, use the universal track of strategic development to achieve the quality of education, and, on the other hand, using the example of Moscow, we have identified unique educational projects aimed at developing intellectual, creative potential of the individual in modern conditions of global digitalization, digital transformation, pandemic threats and challenges.

The school education system of any country or territory can introduce and implement indicators of the global universal track of strategic development in its system, but it can also develop unique educational projects and programs to improve the quality of education.

Thus, it is necessary to emphasize that universal and / or unique indicators are used to form and implement the strategic development of the school educational system in the countries of the world and are an important attribute of the development of the modern educational world space.

REFERENCES

1. PISA 2022 Mathematics Framework. Available at: https://pisa2022-maths.oecd.org/#0verview (accessed on 27.12.2021).

2. Rissom, H. W. (2020). The search for quality in education: Some comments on the international dimension. In Measuring the quality of education, pp. 123-133. CRC Press.

3. Rowley, K. J., McNeill, S. M., Dufur, M. J., Edmunds, Ch., Jarvis, J. A. (2019). Trends in International PISA Scores over Time: Which Countries Are Actually Improving? Social Sciences, 8, 231. doi: 10.3390/socsci8080231.

4. Haw, J. Y., King, R. B., Trinidad, J. E. R. (2021). Need supportive teaching is associated with greater reading achievement: What the Philippines can learn from PISA 2018. International Journal of Educational Research, 110, 101864. doi: 10.1016/j.ijer.2021.101864.

5. Kaplan, D., & Jude, N. (2021). Trend analysis with international large-scale assessments: Past practice, current issues, and future directions. In International Handbook of Comparative Large-Scale Studies in Education: Perspectives, Methods and Findings (pp. 1-14). Cham: Springer International Publishing

6. Mazurek, J., Garcia, C. F., Rico, C. P. (2021). Inequality and Students' PISA 2018 Performance: a Cross-Country Study. Comparative Economic Research. Central and Eastern Europe, 24 (3), 163-183. doi: 10.18778/1508-2008.24.27

7. Gamasa, A., Martinez-Abad, F. An exploration of factor linked to Academic performance in PISA 2018 through data mining techniques). Frontiers in Phsichology, 11: 575167. doi: 10.3389/fpsyg.2020.575167.

8. Cobb, D. J., Couch, D. (2021). Locating inclusion within the OECD's assessment of global competence: An inclusive future through PISA 2018? Policy Futures in Education, 1-17. doi: 10.1177/14782103211006636.

9. Gilleece, L., Nelis, S. M., Fitzgerald, C., Cosgrove, J. (2020). Reading, mathematics and science achievement in DEIS schools: Evidence from PISA 2018. Dublin: Educational Research Centre. doi: 10.13140/RG.2.2.30452.78728.

10. Lavonen, J., Mahlamaki-Kultanen, S., Vahtivuori-Hanninen, S., & Mikkola, A. (2021). Implementation of a national teacher education strategy in Finland through pilot projects. Australian Journal of Teacher Education (Online), 46(10), 21-42. doi: 10.3316/informit.192063000165843.

11. Nelis, S. M., Gilleece, L., Fitzgerald, C., Cosgrove, J. (2021). Beyond achievement: home, school and wellbeing findings from PISA 2018 for students in DEIS and non-DEIS schools. Dublin: Educational Research Centre.

12. Hori, R., Fujii, M. (2021). Impact of Using ICT for Learning Purposes on Self-Efficacy and Persistence: Evidence from Pisa 2018. Sustainability, 13, 6463. doi: 10.3390/su13116463.

13. Kyzym, M., Balian, A., Levanda, O., Gryshova, I., & Samsonova, V. (2021). Impact of Global Digitalization on Public Policy in the Context of Education. Annals of the Romanian Society for Cell Biology, 7045-7052.

14. Ermakova, Y. D. (2020). Changing educational trends in the context of global digitalization of society. Vestnik of Samara State Technical University. Psychological and Pedagogical Sciences, 2, 87-97. doi: 10.17673/vsgtu-pps.2020.2.7.

15. Marouli, C. (2021). Sustainability education for the future? Challenges and implications for education and pedagogy in the 21st century. Sustainability, 13 (5), 2901. doi: 10.3390/su13052901

16. PISA 2012 Results in Focus: What 15-year-olds know and what they can do with what they know. Available at: https://www.oecd.org/pisa/keyfindings/pisa-2012-results-overview.pdf (accessed on 15.11.2021).

17. PISA 2015 Results in Focus. Available at: https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf (accessed on 15.11.2021).

18. PISA 2018 Results (Volume I): What Students Know and Can Do. Available at: https://www.oecd-ilibrary.org/ education/pisa-2018-results-volume-i_5f07c754-en (accessed on 21.10.2021).

19. Moscow listed among world's school education leaders. 4 December 2019. Available at: https://www.mos.ru/en/ news/item/66262073/ (accessed on 24.12.2021).

20. Russia - Country Note - PISA 2018 Results. Available at: https://www.oecd.org/pisa/publications/PISA2018_CN_ RUS.pdf (accessed on 24.12.2021).

21. International Student Assessment Program (2015). Available at: http://www.centeroko.ru/pisa15/pisa15.html (accessed on 24.12.2021).

22. International studies of the quality of education. Available at: https://mcko.ru/pages/i_s_q_e_pisa#PISA-2018 (accessed on 24.12.2021).

23. About the PISA study (Programme for International Student Assessment). Available at: https://fioco.ru/Contents/ Item/Display/2201447 (accessed on 20.12.2021).

24. Poddyakov, A. (2012). Solving complex problems in PISA-2012 and PISA-2015: interaction with complex reality. Educational policy, 6 (62). Available at: https://cyberleninka.ru/article/n/reshenie-kompleksnyh-problem-v-pisa-2012-i-pisa-2015-vzaimodeystvie-so-slozhnoy-realnostyu (accessed on 24.12.2021).

25. Results of the PISA-2018 study in a comparative analysis with the results for all study cycles (2000-2018). Available at: https://fioco.ru/Media/Default/Documents/ISI/Results-PISA2018-benchmarked.pdf (accessed on 24.12.2021).

26. Govorova, E., Benitez, I., Muniz, J. (2020). Predicting student well-being: Network analysis based on PISA 2018. International Journal of Environmental Research and Public Health, 17 (11), 4014. doi: 10.3390/ijerph17114014

27. Eryilmaz, N., Sandoval-Hernandez, A. (2021). The relationship between cultural capital and the students' perception of feedback across 75 countries: Evidence from PISA 2018. International Journal of Educational Research, 109, 101803. doi: 10.1016/j.ijer.2021.101803

Информация об авторах Томюк Ольга Николаевна

(Россия, г. Екатеринбург) Кандидат философских наук, старший научный сотрудник, старший преподаватель кафедры теории государства и права Уральский государственный юридический университет имени В. Ф. Яковлева E-mail: helgago@yandex.ru ORCID ID: 0000-0001-9524-8364 Scopus ID:57211983935

Дьячкова Анна Викторовна

(Россия, Екатеринбург) Кандидат экономических наук, доцент кафедры экономической теории и экономической политики Уральский федеральный университет имени первого Президента России Б. Н. Ельцина E-mail: a.v.diachkova@urfu.ru Scopus ID: 57211156711 ORCID ID: 0000-0003-4970-1820

Киселева Наталия Александровна

(Россия, Москва) Заместитель руководителя Департамент образования и науки города Москвы E-mail: KiselevaNA@mos.ru ORCID ID: 0000-0001-7139-0665

Камка Светлана Васильевна

(Россия, Москва) Кандидат педагогических наук, заместитель директора Корпоративный университет московского образования E-mail:KamkaSV@mioo.ru ORCID ID: 0000-0001-7575-0875

Николенко Ольга Игоревна

(Россия, Москва) Заместитель начальника Управления оценки и сертификации Корпоративный университет московского образования E-mail: NikolenkoOI@mioo.ru ORCID ID: 0000-0002-4503-1711

Information about the authors Olga N. Tomyuk

(Russia, Ekaterinburg) PhD in Philosophy, Senior Researcher, Senior Lecturer, Department of Theory of State and Law Ural State Law University named after V. F. Yakovlev E-mail: helgago@yandex.ru ORCID ID: 0000-0001-9524-8364 Scopus ID: 57211983935

Anna V. Diachkova

(Russia, Ekaterinburg) Associate Professor, PhD in Economics, Associate Professor of the Department of Economic Theory and Economic Policy Ural Federal University named after the first President of Russia B. N. Yeltsin E-mail: a.v.diachkova@urfu.ru Scopus ID: 57211156711 ORCID ID: 0000-0003-4970-1820

Nataliia A. Kiseleva

(Russia, Moscow) Deputy Head Moscow Department of Education and Science E-mail: KiselevaNA@mos.ru ORCID: 0000-0001-7139-0665

Svetlana V. Kamka

(Russia, Moscow) PhD in Pedagogic sciences, Deputy Director Corporate University of Moscow Education E-mail: KamkaSV@mioo.ru ORCID ID: 0000-0001-7575-0875

Olga I. Nikolenko

(Russia, Moscow) Deputy Head of the Evaluation and Certification office Corporate University of Moscow Education E-mail: NikolenkoOI@mioo.ru ORCID ID: 0000-0002-4503-1711

i Надоели баннеры? Вы всегда можете отключить рекламу.