Contemporary digital technologies and innovations in human intelligence

Riabtseva N.K.

11. Chudinov A.P. Rossija v metaforicheskom zerkale: kognitivnoe issledovanie politicheskoj metafory (1991-2000) [Russia in the metaphoric mirror: cognitive research of political metaphor] / A.P. Chudinov. - Ekaterinburg, 2001. - 238 p. [in Russian]

12. Jung C.G. Arkhetip i simvol [Archetype and symbol] / C.G. Jung. - M: Renessans, 1991. - 300 p. [in Russian]

DOI: https://dx.doi.org/10.18454/RULB.11.15 Рябцева Н.К.

ORCID: 0000-0002-2042-4615, доктор филологических наук, Институт языкознания Российской академии наук СОВРЕМЕННЫЕ ЦИФРОВЫЕ ТЕХНОЛОГИИ И ИННОВАЦИИ В ИНТЕЛЛЕКТУАЛЬНОЙ СФЕРЕ

ЧЕЛОВЕКА

Аннотация

Современные цифровые технологии не только "изменяют язык" (Дэвид Кристалл), но и оказывают влияние на интеллектуальную сферу человека, побуждая его совершать множество не свойственных для него ранее операций. В данной статье рассматриваются наиболее существенные инновации в интеллекте человека, которые порождаются новыми информационными технологиями. Эти инновации включают, по мнению ведущих специалистов в области современных компьютерных технологий, такие операции, как многозадачность, "серендипность ", коннективность, гипермодальность, визуальность и киберсемиотическая конвергентность объективной и виртуальной реальности. Статья основана на исследованиях, в первую очередь, следующих ученых: Лари Розен, Джей Дэвид Болтер, Стивен Даунз, Джей Лемке, Гюнтер Кресс, Сёрен Бриер и др. В их работах особо отмечается значительное влияние цифровых технологий и интернет-коммуникации на все стороны жизни общества, на внутренний психологический и интеллектуальный мир человека, на профессиональную и образовательную деятельность, а также подчеркивается важность соответствующих исследований и недостаточное использование преимуществ интернет-коммуникации и цифровых технологий в научной, просветительской, образовательной, общественной и культурной деятельности. Особое внимание в статье уделено тенденции к визуализации в глобальных информационных потоках и ее роли в обработке информации и трансфере знаний. В статье подчеркивается также, что влияние современных цифровых технологий на все стороны жизни человека, включая интеллектуальную деятельность, нуждается в дальнейшем углубленном исследовании.

Ключевые слова: инновации в работе интеллекта человека, киберсемиотика, трансфер знаний.

Riabtseva N.K.

ORCID: 0000-0002-2042-4615, PhD in Philology, Institute of Linguistics, Russian Academy of Sciences CONTEMPORARY DIGITAL TECHNOLOGIES AND INNOVATIONS IN HUMAN INTELLIGENCE

Abstract

New digital technologies not only "change language" (David Cristal), but also "upgrade" human intelligence making it perform new and uncommon operations. The present paper is an analysis and a survey of most prominent innovations in human intelligence, which are instigated by the latest digital information technologies. These innovations include, according to the point of view of outstanding specialists in contemporary digital technologies, such operations as multitasking, serendipity, connectivity, hypermodality, visuality, and cybersemiotic convergence of objective and virtual reality. The paper is based on the data presented in the publications of such outstanding "digital" specialists as Larry Rosen, Jay David Bolter, Steven Downes, Jay Lemke, Gunther Kress, Soren Brier, etc. In their works they particularly stress the impact of digital technologies and internet communication on all spheres of human activities, their role in the inner psychological and mental states, in professional and educational domain, as well as the importance of their investigation and a gap between the intensive development of digital technologies and their insufficient usage in scientific, didactic, social and cultural life. Special attention in the paper focuses on the tendency towards visualization in the global information flows and its role in information processing and knowledge transfer. The paper particularly stresses the fact that the impact of contemporary digital technologies on all spheres of human activities, including the intellectual one, needs further and profound investigation.

Keywords: innovations in human intelligence, cybersemiotics, knowledge transfer.

Почта авторов / Author Email: [email protected]

Introduction

Digital/ information technologies not only promote automatic information retrieval and processing, as well as human language, but also introduce various kinds of innovations into almost all spheres of contemporary human activities. Besides, digital technologies promote all kinds of knowledge transfer and its integration, instigate creative and intellectual human activities, generate new digital culture, communication and education, give rise to various convergent socio-technical interfaces, etc. Of particular importance and interest are those new mental/ intellectual operations, states and processes that are provoked in the human mind by contemporary technological innovations.

Methods of investigation

Digital technologies make human intelligence and cognitive system function in a new info-intellectual space -the cyberspace. Its impact is being traced in various investigations directly and indirectly connected with cognitive studies. The identification, qualification and systematization of the relevant data are the main principles of investigation undertaken in the present study. It shows that digital technologists consider the following innovations in human intelligence, provoked by digital technologies, most important and perspective: 1) multitasking [54]; 2) serendipity [17]; 3) connectivity (of hypertext and thus of human consciousness, cognition, intelligence, science, education, etc.) [26]; 4) hypermodality (of displaying, processing, retrieving and combining information of different types/ modes in digital systems and thus in the human mind)

[40]; 5) the tendency to visuality of information flows in contemporary cyberspace and in the style of information processing in the human mind [16]; [63]; 6) cybersemiotic convergence/ transfer of the objective and virtual reality into the "mixed" reality and thus the emergence of the ability of the human mind to operate in the new "augmented" information sphere [17]; [18]; [19]. These new operations, states, processes and tendencies closely interact, have a dynamic, heuristic and cognitive character, have their "traditional precursors" and reflect innovations in the human intelligence, provoked and promoted by modern digital technologies.

Results and discussion

Multitasking. Multitasking is a term introduced in its present meaning and discussed in detail by Larry Rosen, computer psychologist Number One in the world. His experiments and data testify to the effect that: 1) The younger generation is eager to use all kinds of digital gargets and in most cases - at the same time, simultaneously. 2) They listen to the music while chatting with their friends and browsing the net, editing their new photos, doing their homework, etc. 3) Multitasking is provoked by multimedia character of digital technologies, and thus promotes a new intellectual "habit" of combining adjacent mental activities and fulfill them simultaneously.

Larry Rosen stresses that "The stark reality is that today's kids just can't do one task without wanting to do a bunch of other things at the same time. It's a way of life for them. The natural inclination to multitask in these young kids probably has many sources, including the cool, dazzling, multifunctional new devices that permit and encourage multitasking... Cell phones, laptops, iPods, and other portable computing devices are spreading at an incredible rate. Some of these devices that started out as single-purpose machines, such as the cell phone, are being turned into general-purpose computing devices that allow users to perform a variety of functions, sometimes simultaneously. The cell phone evolved into a smartphone and is now literally a portable computer. Psychology has shown that certain physical and mental behaviors can be encouraged by physical objects. Modern technological devices. automatically encourage multitasking by their users. Just take a look at any computer screen and you will rarely see just one open window. Right now, for example, I have my word processor open along with my email, instant messenger, and six web browser windows [54, p. 76-77].

It is quite illuminating that the first published use of the word "multitask" appeared in an IBM paper (dated 1965) describing the capabilities of the IBM System [45], and the first (and the only) world-known "multitasking" person (in the history of mankind) was Caesar. At present it is obvious that multitasking provokes a new cognitive style of acquiring and applying knowledge and experience by using innovative digital technologies [48] which give rise to all other intellectual innovations in the human mind, serendipity being one of them.

Serendipity. Serendipity is a complex heuristic process which was detected by an outstanding computeriser Jay Bolter, who came to the conclusion that new computer technologies give rise to innovative mental processes and operations which the user has to accomplish in order to fulfill his information processing tasks. Jay Bolter's most famous words in this connection are the following: "Digital culture is a browsing culture; for better or worse, serendipity is a fundamental feature" [17, p. 38]. Contemporary browsers evolve very quickly and become more and more user

friendly: they facilitate all kinds of information retrieval and processing in various modes and "directions", thus making the human—computer interface more convenient and thought provoking. Now browsing is becoming a new type of breathtaking journey with quite unexpected ways of getting to the point of destination because it is accompanied by getting "adjacent" types of (more or less) relevant knowledge and experience.

The notion "serendipity" has derivatives serendipitous, serendipitously and serendipitor. It is used in various communicative situations and is quite matter-of-fact because its new meaning is closely connected with its traditional ones (dating back to 1754): 1. The faculty of making fortunate discoveries by accident; 2. The fact or occurrence of such discoveries; 3. An instance of making such a discovery [56]. Cf. "good luck in making unexpected and fortunate discoveries, (hyperonym) good luck, fluke, good fortune" [57]; "the faculty or phenomenon of finding valuable or agreeable things not looked for: Serendipity seemed to follow the lucky winner where ever he went" [58].

In the 20th century, the word serendipity was sometimes used by researchers to attract attention to "unintentional" scientific discoveries (for more detail, see [21]; [11]; [55]). Now it is used in a more "subject-matter" manner. In 2010, ISMAR, an international academic conference on Mixed and Augmented Reality (Seoul), selected three artworks for the related exhibition; one of them was Serendipitor, by Mark Shepard. It was an alternative GPS navigation software application for mobile phones that determines a route to a destination that the user has not previously taken, designed to facilitate finding something by looking for something else. Serendipitor was developed during Mark Shepard's Summer Session 2010 at V2_Lab and was part of his broader project Sentient City Survival Kit. [32]. (By the way, analogously, the word "justification" was first registered in 1551 (for detail, see [47, p. 134]), but at present it is used mostly for naming a text formatting task in a computer).

At present, the intellectual state of "serendipity" is also called "browsering" and is adjacent to another one, connectivity.

Connectivity. "At its heart, connectivism is the thesis that knowledge is distributed across a network of connections, and therefore that learning consists of the ability to construct and traverse those networks", thus, "our knowledge is literally the set of connections between neurons in the brain (or between bits in a computer, or between people in a society.)" [26, p. 85, 16].

At present, connectivity is considered to be a most characteristic and prominent feature in internet communication [27, p. 25]. It is displayed by hypertextual links and exposes connections of various types not only in digital technologies and texts, with the help of which it makes all types and pieces of information interconnected with each other, but also shows cognitive links between everything that has to do with the intellectual sphere of the human mind [13]; [28]. These are consciousness, cognition, science, knowledge and information processing, education, creativity, communication, behaviour and action [39]; [14]. Their "connectivity" gives rise to a number of new cognitive perspectives in science and education, e.g. connective knowledge, networked knowledge, knowledge management, etc. [20]. Hypertextual links connect every text with all adjacent texts and thus make it a "super-text" with quite new, unexpected, creative and cognitively charged characteristics. Thus, evolving digital technologies provoke new creative abilities and "habits" in the human mind and transfer the

cognitive into the intellectual [6]; [8]. In particular, hypertextual links, along with multimodal way of information retrieval, give rise to quite new, hypermodal way of information and knowledge representation and processing [25].

Hypermodality. "Hypermodality is the conflation of multimodality and hypertextuality. Not only do we have linkages among text units of various scales, but we have linkages among text units, visual elements, and sound units... In hypermedia, there are more kinds of connection than those provided for in print genres" [40, p. 301].

Hypermodality of information and knowledge representation, perception, processing, transfer, disseminating, displaying, retrieving, etc. in digital communication means using and combining various modal (semiotic, visual, multimedia) resources for navigation, information layout and their combination in order to make the way to information and knowledge shorter, easier, more direct and even language independent [40; 41]. Consider the new "computer" meanings of such symbols as "plus" (to enlarge), "minus" (to diminish), "crossing" (to close a file). Increasing hypermodality of information processing in digital communication is aimed, on the whole, at making information retrieval more creative and user friendly [64]; [1]; [3]; [5]. J. Lemke «cites the "hypermodality" of digital text to result in its creation by both the 'user' and the 'reader', making it 'far less predictable' for the designer» [40, p. 300].

Zhang and O'Halloran [64], in their turn, show how the analysis of a range of hypermodal and semiotic resources such as colour, links, and the representation of social actors on University webpages "reveal the way that marketisation has changed over the past decade, shifting away from a more corporate type branding into more personalised relationships. In our societies semiotic resources are continually used in new and fresh ways, and as is the nature of communication, these will be harnessed by different kinds of interests to disseminate discourses that serve strategic ideological purposes. These discourses will always have a fundamentally multi-semiotic nature, and while people may feel their power in different ways, these may be experienced as fun, play, leisure, and simply as part of the almost invisible micro details of our sociality" [44, p. 354], as well as intellectuality.

In other words, combining information of different types/ modes and modalities in digital systems makes the human mind more "semiotically and hypermodally oriented" and easily operate with new meanings of mathematical, graphic and all other "visual" symbols, icons, pictures, figures and their combinations and blendings. All these are extensively used for various and important information processing goals: to provide a many-faceted access to information, to propose various navigation stiles in detecting it, to switch from verbal to non-verbal, visual form in presenting it, etc. [33]. Kress and Van Leeuwen define hypertimodal texts as "making meaning in multiple articulations" [36, p. 4]. Where the elements give the composition a whole meaning visual grammar can be applied [43, p. 130].

Visuality. The tendency to visuality of information flows in contemporary cyberspace and in the style of information processing in the human mind [16] was triggered and fostered by rapid and absolutely unexpected revolutionary development of digital video cameras which are now installed almost everywhere. Thus, the global information flow is changing its character: it becomes much more video-oriented than text-oriented [63]. Cf.:

"The video surveillance industry is undergoing strong growth in demand worldwide, which evolve into intelligent, integrated and «networked» systems. Current market needs imply that users must access video, audio and data surveillance networks which are not just stationary. They must be fully mobile and portable in nature. They must provide real- or near-real-time sensory inputs, collected from mobile vehicles and stationary locations. Such inputs must be aggregated at a central location in real-time with the goal of providing a cognitive reaction to a condition or event. These networks enable real-time monitoring and require integration with analytics and sensor data analysis and the ability to «push» information to mobile users for the purposes of reaction and response. to video streams" [51] (Bold is added - N. R.).

In this connection, many scholars believe that we are now faced with a new cognitive revolution that is gaining ground in information perception, dissemination, and processing [29]; [35]; [36]; [37]; [34]; [7]. Cf. «The sheer volume of new technologies devoted to the transfer, transmission, and production of graphics and visual imagery would appear to have given rise to a new cognitive field. because electronic images are "a new form of visibility"» [31].

Thus, we are becoming more visually oriented in cognition and communication, and much more engaged in decoding, transcoding and deverbalization of verbal information and verbalization of visual information, etc. [42]; [65], cf. "The tension between verbal and visual representation seems more important than ever. We are living in a space, a cyberspace, with a specific new culture where visualisation as a form of communication is becoming predominant" [16, p. xii].

This particular tendency to visuality in the contemporary digital and thus general culture is exceptionally important for education and training, cf. "Visual communication is the sort of culture that stimulates the right hemisphere in a special way. If new experiences imply new developments while the plasticity of the brain enables them, educators must be aware of their role because the brains of today's children are being structured in language patterns antagonistic to the values and goals of formal education" [38, р. 234-235]. As a whole, "Human versatility, creativity and search for novelty have not been inhibited but rather instigated by the electronic technologies. Teachers have to think very seriously of. profiting as much as they can from the learning facilities offered by the new technologies" [24, p. 242]; "The use of pictures is a quick and efficient technique for committing words to memory" [61, р. 102].

Thus, educators must be also aware "of the existence of different forms of representation and of their implications in the different information processing styles: different forms of representation or the use of more than one form of representation may lead to better results in terms of the rapidity and the efficiency of comprehension of the contents and in terms of expressing our thoughts" [16, р. 76]; cf. [60]; [52]. Moreover, "The children. are better prepared for dealing with computing concepts, the virtual reality world of cyberspace, the internet and hypertext than their parents are because they have acquired a repertoire of social practices that link computerbased artefacts to the structure of self' [59, р. 221-222]; [23]. That is why «The new generation. possesses a "new literacy", as "computency" or "computent" and may feel more receptive to new kinds of educational methods. This may mean that the ability to read print and the possession of background knowledge that makes reading

meaningful are necessary but not sufficient for today's young. Besides, "computency" requires the connection of the technology to a constellation of cultural associations» [59, p. 229].

In general, all these tendencies show that our cognitive system and communication become more and more deverbalized and semiotically, hypermodally and visually oriented. For example, the simple "verbal"/ discursive idea of "very much" can be expressed in the following "semiotic" way: Goooooooooooogle [cf. 62]. "Few (if any) linguistic anthropologists would argue with the idea that linguistic practice draws on diverse material and embodied resources. Nevertheless, close attention to the role of visual semiosis in communicative ecologies is not as common a part of our analyses as might be expected. explicit and sustained attention to multimodal integration remains a frontier for our field. as well as .kinds of tools that are necessary to account for the multiple ways in which visual forms interact with other linguistic modalities" [4, p. 352], as well as with one another, particularly in the case when there is a cybersemioticconvergence of the objective and virtual reality.

Cybersemiotic convergence/ transfer of the objective and virtual reality. The cybersemiotic convergence/ transfer of the objective and virtual reality into the "mixed" (blended/ mediated/ enhanced/ augmented) reality and thus the emergence of the ability of the human mind to operate in the new "augmented" information sphere [17] is "visual innovation" number one in today's cyberspace. "Augmented reality (AR) is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified by a computer. As a result, the technology functions by enhancing one's current perception of reality. By contrast, virtual reality replaces the real world with a simulated one.. With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally manipulable" [12].

Augmented ("mixed") reality is a new type of visual information. It integrates objective and virtual reality, surpasses the boundaries of human perception, promotes imagination and makes the human mind function in an innovative way. The technology itself is becoming wildly used in various professional, educational and other fields, particularly in training, fulfilling difficult tasks that need "the third/ artificial" eye, etc. Many specialists are sure that digital

technologies and the systems of augmented reality are making human mind more flexible and effective [22].

A Mixed/ Augmented Reality (AR) environment "enhances the users' perception and improves the intuitive interaction with the real world. Virtual Reality (VR) technology completely immerses a user inside a synthetic environment. While immersed, the user cannot see the real world around him. In contrast, AR allows him to see the real world with superimposed, virtual objects. Therefore, AR supplements the real world rather than completely replacing it. In most cases, a VR environment includes a very complex technical installation and thus its technology is mostly used for expensive training simulations (e.g. flight simulators, ship simulators, etc.). One of the main goals of AR is to reduce costs and to use cheaper hardware with the goal to achieve the same results. . Of course, we will find more possible AR applications and we believe that it is just a starting point to get new ways of using this fascinating technology" [30] (Bold is added - N. R.).

Conclusions and implications

Digital communication and technology are an absolutely new and a most creative sphere of human activities. Its impact on human mind, consciousness, cognition, communication, behaviour and social interaction [46], [2] is particularly important because it helps realize that human intelligence is evolving so that to meet the challenges of virtual reality and its blending with objective reality. Thus we are making a step "from augmented reality" to "augmented human" [49]: this is a transition from technological "human—computer interaction" to intellectual "human— computer integration".

Multimedia, browsing, hyperlinks, digitally processed visual information, augmented reality and, as a whole, a cybersemiotic character of digital technologies cannot but make human mind operate in quite new and "intelligence-promoting" circumstances. These not only enhance mental operations that we have to fulfill, but also give an impetus to all spheres of human activities.

As far as human intelligence is concerned, it becomes obvious that digital technologies make it more flexible, active, open and effective. (For more particulars and detail about the influence of digital technologies on human language, mind, behaviour, culture and social life, briefly outlined here, see [15]; [50]; [4]; [9]; [10]; [53]). It thus also becomes obvious that the impact of contemporary digital technologies on all spheres of human activities, including the intellectual one, needs further, profound and complex investigation.

Список литературы / References

1. Рябцева Н. К. Гипермодальность социальной коммуникации в интернет-пространстве / Н. К. Рябцева // Дискурс как социальная деятельность: Приоритеты и перспективы. Материалы второй международной научной конференции. 16-17 октября 2014 г. Ответственный редактор И. И. Халеева. Часть 2. - М.: ФГБЩУ ВПО МГЛУ, 2014. - С. 96-98.

2. Рябцева Н. К. Грамматика конструкций, словари сочетаемости, современные информационные технологии и преподавание иностранных языков [Электронный ресурс] / Н. К. Рябцева // Лингвистика и методика преподавания иностранных языков: Периодический сборник научных статей. Электронное научное издание. - М.: ФГБУН Институт языкознания РАН, 2014. - № 6. - С. 214-247. URL: http://www.iling-ran.rU/library/sborniki/for_lang/2014_06/9.pdf. (дата обращения: 19.10.2016).

3. Рябцева Н. К. Гипермодальность социальной коммуникации в интернет-пространстве: Приоритеты и перспективы [Электронный ресурс] / Н. К. Рябцева // Вестник Московского государственного лингвистического университета. Серия: Языкознание. - М. - 2015. - № 7. - C. 513-520. - URL: http://www.vestnik-mslu.ru/Vest-2015/Vest15-717z.pdf (дата обращения: 19.10.2016).

4. Рябцева Н. К. Тенденция к визуализации в современном информационном пространстве, проблемы образования и инновационные технологии в преподавании иностранных языков [Электронный ресурс] / Н. К. Рябцева

// Лингвистика и методика преподавания иностранных языков. - М.: ФГБУН Институт языкознания РАН, 2015. - № 7.

- C. 345-368. - URL: http://www.iling-ran.ru/library/sborniki/for_lang/2015_07/13.pdf. (дата обращения: 19.10.2016).

5. Рябцева Н. К. Социолингвистические и стилистические инновации в современном коммуникационном пространстве / Н. К. Рябцева // Профили языка: социолингвистика, национальное варьирование, переводоведение, контрастивная стилистика. Сборник трудов к 90-летию со дня рождения А. Д. Швейцера. - М.: ФГБУН Институт языкознания РАН, 2015. - C. 55-62.

6. Рябцева Н. К. «Контент» - «коннект» - «texting» в новом информационном киберпространстве / Н. К. Рябцева // Логический анализ языка. Информационная структура текстов разных жанров и эпох. Ответственный редактор Н. Д. Арутюнова. - М.: Индрик, 2016. - C. 149-160.

7. Рябцева Н. К. Современные информационные технологии и прикладные проблемы преподавания иностранных языков / Н. К. Рябцева // «Прикладная лингвистика в науке и образовании. ALPAC REPORT - полвека после разгрома». К юбилею профессора Беляевой Л.Н. Труды VIII Международной научной конференции. 24-26 ноября 2016 г. - СПб.: Книжный Дом, 2016. - C. 316-321. URL: https://elibrary.ru/item.asp?id=28851041 (дата обращения 12.08.2017).

8. Рябцева Н. К. Язык и стиль интернет-коммуникации: когнитивный аспект / Н. К. Рябцева // Когнитивное моделирование. Труды Четвертого Международного форума. В 2-х частях. Ллорет де Мар, Испания, 11-18 сентября 2016 г. - Ростов-на-Дону : Общество с ограниченной ответственностью «Фонд науки и образования», 2016. - Часть 1.

- С. 213-222.

9. Рябцева Н. К. Современные информационные технологии и интеллектуальный мир человека: «From augmented reality to augmented human» / Н. К. Рябцева // Когнитивное моделирование. Труды Четвертого Международного форума. В 2-х частях. Ллорет де Мар, Испания, 11-18 сентября 2016 г. - Ростов-на-Дону : Общество с ограниченной ответственностью «Фонд науки и образования», 2016. - Часть 2. - С. 412-421.

10. Рябцева Н. К. Отличительные особенности интернет-коммуникации в металингвистическом и прикладном аспекте [Электронный ресурс] / Н. К. Рябцева // Лингвистика и методика преподавания иностранных языков: Периодический сборник научных статей. Электронное научное издание. - М.: ФГБУН Институт языкознания РАН, 2017. - № 9. - С. 387-429. URL: http://www.iling-ran.ru/library/sborniki/for_lang/2017_09/ (дата обращения: 24.06.2017).

11. Ярошевский М. Г. Уолтер Кеннон (1871-1945) / М. Г. Ярошевский, С. А Чеснокова. - М.: Наука, 1976. - 376 с.

12. Augmented_reality // Wikipedia [Electronic resource]. URL: http://en.wikipedia.org/wiki/ Augmented_reality (accessed 31.07.2017).

13. Barnet B. Memory Machines: The Evolution of Hypertext. / B. Barnet. - Anthem Press, 2013. - 192 p.

14. Bennett W. L. The logic of connective action / W. L Bennett, A. Segerberg // Information, Communication & Society.

- 15:5. - 2012. - P. 739-768, DOI: 10.1080/1369118X.2012.670661. [Electronic resource]. URL: http://dx.doi.org/10.1080/1369118X.2012.670661 (accessed 19.10.2016).

15. Bergvall-Kareborn B. Persistent problems and practices in information systems development: a study of mobile applications development and distribution / B. Bergvall-Kareborn, D. Howcroft // Information Systems Journal. - V. 24, No. 5.

- 2014. - P. 425-444. [Electronic resource]. http://onlinelibrary.wiley.com/doi/10.1111/isj.v24.5/issuetoc. URL: http://onlinelibrary.wiley.com/doi/10.1111/isj.12036/abstract. (accessed 29.07.2017).

16. Bolter J. D. Writing Space: Computers, Hypertext and the Remediation of Print / J. D. Bolter. - London : Lawrence Erlbaum Associates, 2001. - 248 p.

17. Bolter J. D. Examining and Changing the World of Media / J. D. Bolter // Humanistic Perspectives in a Technological World. Ed. by Richard Utz, Valerie B. Johnson, etc. - Atlanta : School of Literature, Media, and Communication, Georgia Institute of Technology, 2014. - P. 37-39.

18. Brier S. Cybersemiotics: Why Information is not Enough! / S. Brier. - Toronto, Canada : University of Toronto Press, 2008. - 498 p.

19. Brier S. Cybersemiotics: A New Foundation for Transdisciplinary Theory of Information, Cognition, Meaningful Communication and the Interaction Between Nature and Culture / S. Brier // Integral review. - V. 9, No. 2. - 2013 [Electronic resource]. URL: http://integralreview.org/documents/Brier, Cybersemiotics, Vol. 9, No. 2.pdfhttp://integralreview.org/documents/Brier,%20Cybersemiotics,%20Vol.%209,%20No.%202.pdf (accessed: 19.10.2016)

20. Brown J. S. Minds on fire: Open education, the long tail, and Learning 2.0. / J. S. Brown, R. P. Adler // Educause Review. - 2008. - 43 (1). [Electronic resource]. URL: http://er.educause.edu/articles/2008/1/minds-on-fire-open-education-the-long-tail-and-learning-20 (accessed 30.07.2017).

21. Cannon W. The way of an investigator: a scientist's experiences in medical research / W. Cannon. - New York: «Norton», 1945. - 267 p.

22. Chinthammit W. iFiction: Mobile Technology, New Media, Mixed Reality and Literary Creativity in English Teaching / W. Chinthammit, A. Thomas // IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH), Atlanta, GA, USA. -2012. - Nov. 5-8. P. 39-46. [Electronic resource]. URL: http://www.computer.org/csdl/proceedings/ismar-amh/2012/4663/00/06483987.pdf. (accessed 28.07.2017).

23. Cope B. «Multihteraties» / B. Cope, M. Kalantzis // New Literacies - New Learning Pedagogies: An International Journal. - 2009. - 4 (3). - P. 164-195.

24. Crystal D. Language and the Internet / D. Crystal. - Cambridge: Cambridge University Press, 2001. - 272 p.

25. Djonov E. Website hierarchy and interaction between content organization, webpage and navigation design: A systemic functional hypermedia discourse analysis perspective / E. Djonov // Information Design Journal. - 2007. - № 15/2. -P. 313-330.

26. Downes S. Connectivism and Connective Knowledge. Essays on meaning and learning networks / S. Downes. -Version 2012. - 616 p. [Electronic resource]. URL: http://www.downes.ca/post/58207 (accessed: 31.07.2017).

27. Downes S. Toward Personal Learning / S. Downes. - 2017. - 757 p. [Electronic resource]. URL: http://www.downes.ca/files/books/Toward%20Personal%20Learning%20v09.pdf (accessed: 31.07.2017).

28. Ensslin A. Canonising Hypertext: Explorations and Constructions / A. Ensslin. - Universität Heidelberg, Faculty of Modern Languages, 2006. [Electronic resource]. URL: http://linguistlist.org/pubs/diss/browse-diss-action.cfm?DissID=13780. (accessed 28.07.2017).

29. Fletcher R. The impact of culture on web site content, design, and structure: An international and a multicultural perspective / R. Fletcher // Journal of Communication Management. - 2006. - № 10/3. - P. 259-273.

30. Haller M. Mixed Reality and Education / M. Haller. [Electronic resource]. URL: http: //mi-lab.org/wp-content/blogs.dir/1/ files/publications/Haller%20-%20MApEC%202004%20%20Mixed%20Reality%20@%20Education.pdf (accessed 28.07.2017).

31. Hubert Ch. Visuality / Ch. Hubert. [Electronic resource]. URL: http://www.christianhubert.com/writings/visuality.html. (accessed 31.07.2017).

32. ISMAR // An international academic conference on Mixed and Augmented Reality. - Seoul. - 2010. [Electronic resource]. Exhibition. http://v2.nl/events/international-symposium-augmented-reality. (accessed 2.08.2017).

33. Johnson D. Enterprise AJAX: Strategies for building high performance web applications / D. Johnson, A. White, A. Charland. - Upper Saddle River, NJ : Prentice Hall, 2008. - 497 p.

34. Kostelnick Ch. Designing visual language: Strategies for professional communicators / Ch. Kostelnick, D. Roberts. -Boston, Massachusetts : Allyn and Bacon, 2011. - 432 p.

35. Kress G. Visual and verbal modes of representation in electronically mediated communication: the potentials of new forms of text / G. Kress // I. Snyder (Ed.). Page to Screen. Taking literacy into the electronic era. - London, New York : Routledge, 1998. - P. 53-79.

36. Kress G. Reading Images: The Grammar of Visual Design / G. Kress, T. van Leeuwen. - London : Routledge, 2006. -294 p.

37. Kress G. Multimodality: A social semiotic approach to contemporary communication / G. Kress. - London : Routledge, 2010. - 212 p.

38. Lanham R. A. The Electronic word. Democracy, technology, and the arts / R.A. Lanham. -Chicago, Illinois : The University of Chicago Press, 2010. 302 p.

39. Landow G. P. Hypertext 3.0: New Media and Critical Theory in an Era of Globalization / G. P. Landow. - Baltimore : The Johns Hopkins University Press, 2006. - 456 p. [Electronic resource]. URL: https://jhupbooks.press.jhu.edu/content/hypertext-30 (accessed 01.08.2017).

40. Lemke J. L. Travels in hypermodality / J.L. Lemke // Visual Communication. - 2002. - № 1/3. - P. 299-235.

41. Lemke J. L. Multimodal genres and transmedia traversals: Social semiotics and the political economy of the sign / J. L. Lemke // Semiotica. - № 173. - 1/4. - 2009. - P. 283-297.

42. Louwerse M. M. Introduction: Hot Topics in Information Research and Design / M. M. Louwerse, O. Wrede // Information Design Journal. - Vol. 20. - N. 3. - 2013. - P. 266-266(1). DOI: 10.1075/idj.20.3.061lou. [Electronic resource]. URL: http://www.ingentaconnect.com/content/jbp/idj/2013/00000020/00000003/art00006. (accessed 01.08/2017).

43. Machin D. Introduction to Multimodal Analysis / D. Machin. - Hodder Education : London. Penguin. 'Home', 2007. - 224 p.

44. Machin D. What is multimodal critical discourse studies? / D. Machin // Critical Discourse Studies. - 2013. - 10:4. -P. 347-355. DOI: 10.1080/17405904.2013.813770/ URL: http://dx.doi.org/10.1080/17405904.2013.813770Z (accessed 01.08/2017).

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

45. Multitasking // Wikipedia [Electronic resource]. URL: https://en.wikipedia.org/wiki/Human_multitasking. (accessed 29.07.2017).

46. Nakamura T. The action of looking at a mobile phone display as nonverbal behavior / communication: A theoretical perspective / T. Nakamura // Computers in human behavior. - Volume 43, - February 2015. - P. 68-75. [Electronic resource].

47. Newmark Р. Paragraphs on Translation / P. Newmark. - Clevedon : Multilingual Matters, 1993. - 186 p.

48. NYU Langone Medical Center / New York University School of Medicine. "Study reveals how brain multitasks: Findings help explain how the brain pays attention to what's important and how neural circuits may be 'broken' in attention-deficit disorders." // ScienceDaily. - 21 October 2015. [Electronic resource]. URL: www.sciencedaily.com/releases/2015/10/151021135619.htm. (accessed 03.08.21017).

49. Rekimoto J. From Augmented Reality to Augmented Human / J. Rekimoto // ISMAR 2013: The premier international conference on research into the science, technology, applications, and uses of Mixed and Augmented Reality. - October 1-4th, Adelaide, SA, Australia. - 2013. - Abstracts. - [Electronic resource]. URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6671755 (accessed 19.10.2016).

50. Roig-Marín A. 'Blended' Cyber-Neologisms: New words show how our world is changing / A. Roig-Marín // English Today. - Volume 32. - Issue 4. - December 2016. - P. 2-5. DOI: https://doi.org/10.1017/S0266078416000274 (accessed 1.08.2017).

51. Patton's Visuality Solutions. [Electronic resource]. URL: http://www.patton.com/guides/Visuality_Solutions_Guide-med_res.pdf. (accessed 1.08.2017).

52. Petrie G. M. Visuality and CALL research / G. M. Petrie // CALL Research Perspectives. Ed. by Egbert, Joy L., Petrie Gina M. - Lawrence Erlbaum Associates, 2005. - P. 102-108. - URL: http://www.erlbaum.com/ (accessed: 19.10.2016)

53. Riabtseva N. K. Internet communication: a linguistic and cognitive perspective / N.K. Riabtseva // Russian Linguistic Bulletin. - 2016. - V. 4 (8). Р. 70-73. Mezdunarodnyj naucno-issledovatel'skij zurnal №4 (8). 2016. URL: http://rulb.org/en/article/internet-kommunikaciya-v-lingvisticheskom-i-kognitivnom-aspekte/; http://elibrary.ru/item.asp?id=27545126; DOI: https://dx.doi.org/10.18454/RULB.8.13 (accessed 03.08.21017).

54. Rosen L. Rewired: Understanding the iGeneration and the Way They Learn / L. Rosen. - Macmillan, 2010. - 257 p.

55. Selye H. From dream to discovery: On being a scientist / H. Selye. - New York: McGraw-Hill. - 1964. - 368 p.

56. Serendipity // The American Heritage Dictionary of the English Language. - [Electronic resource]. URL: https://www.ahdictionary.com/word/search.html?q=serendipity (accessed 1.08.2017).

57. Serendipity // WordNet 2.0. - [Electronic resource]. URL: http://perevodchik.babylon-software.com/английский/английский/wordnet-20/ (accessed 1.08.2017).

58. Serendipity // Glossary of esoteric words. Serendipity. - [Electronic resource]. URL: http://perevodchik.babylon-software.com/английский/английский/glossary-of-esoteric-words/ (accessed 1.08.2017).

59. Smith R. Children, computers and life online: education in a cyber-world / R. Smith, P. Curtin // I. Snyder (Ed.). Page to Screen. Taking literacy into the electronic era. - London, New York : Routledge, 1998. - P. 211-233.

60. Snyder I. Page to screen / I. Snyder // I. Snyder ^d.). Page to Screen. Taking literacy into the electronic era. -London, New York : Routledge, 1998. - P. xx-xxxvi.

61. Theriault D. The use of pictures in L2 vocabulary learning: Measuring the processing of forms and meanings / D. Theriault, P. Trofimovich // ISTAL-20, Greece: 20th International Symposium on Theoretical and Applied Linguistics. -Department of Theoretical and Applied Linguistics. School of English, Aristotle University of Thessaloniki. - Thesis. - 2013. - P. 102. [Electronic resource]. URL: http://www.enl.auth.gr/ISTAL20. (accessed 31.07.2017)

62. Verheijen L. The Effects of Text Messaging and Instant Messaging on Literacy [Electronic resource] / L. Verheijen // English Studies. - 2013. - № 94(5). - Р. 582-602. DOI: http://dx.doi.org/10.1080/0013838X.2013.795737 (accessed 31.07.2017).

63. Zantides E. Semiotics and Visual Communication: Concepts and Practices [Electronic resource] / E. Zantides (ed.). -Cambridge : Cambridge Scholars Publishing, 2014. URL: http://www.cambridgescholars.com/semiotics-and-visual-communication-6 (accessed: 19.10.2016).

64. Zhang Y. The gate of the gateway: A hypermodal approach to university homepages / Y. Zhang, K. L. O'Halloran // Semiotica. - 2012. - № 190(1/4). - P. 87-109.

65. Zhao S. Intersemiotic relations as logogenetic patterns: Towards restoration of the time dimension in hypertext description / S. Zhao // New Discourse on Language: Functional Perspectives on Multimodality, Identity, and Affiliation. -London. - 2010. - P. 195-218.

Список литературы на английском / References in English

1. Riabtseva N. K. Gipermodalnost' socialnoy communicatsii v internet-prostranstve [Hypemodality of social communication in internet] / N. K. Riabtseva // Discurs kak sociallnaya activnost': Prioritety i perspectivy. Materialy vtoroy mezhdunarodnoy nauchnoy konferentsii. 16-17 oktiabria 2014. Chast' 2. [Discourse as social activity: Priorities and perspectives. October, 16—17, 2014. Proceedings. Part 2.]. Otvetstvennyj redactor I.I. Xaleeva [Ed. by I.I. Khaleeva]. Moskva : MGLU, 2014. - P. 96-98. [in Russian].

2. Riabtseva N. K. Grammatika konstruktsij, slovari sochetaemosti, sovremennye informatsionnye texnologii i prepodavanye inostrannyx yazykov [Construction grammar, combinatory dictionaries, modern information technologies and foreign language learning] / N. K. Riabtseva // Linguistika i metodika prepodavania inostrannyx yasykov. [Linguistics and foreign language teaching]. - Moskva : Institute of Linguistics, Russian Academy of Sciences. - 2014. - V. 6. P. 214-247. [Electronic resource]. URL: http://www.iling-ran.ru/library/sborniki/for_lang/2014_06/9.pdf. (accessed 19.10.2016) [in Russian].

3. Riabtseva N. K. Gipermodalnost socialnoy communicatsii v internet-prostranstve: Prioritety i perspectivy [Hypemodality of social communication in internet: Priorities and perspectives] / N. K. Riabtseva // Vestnik Moskovskogo gosudarstvennogo lingvisticheskogo universiteta. Seria: Yazykoznanie. [Bulletin of the Moscow state linguistic university. Series: Linguistics]. - 2015. - № 7. - P. 513-520. [Electronic resource]. URL: http://www.vestnik-mslu.ru/Vest-2015/Vest15-717z.pdf (accessed 19.10.2016) [in Russian].

4. Riabtseva N. K. Tendencia k vizualizacii v sovremennom informacionnom prostranstve, problemy obrazovania i innovacionnye texnologii v prepodavanii inostrannyx yazykov [A trend towards visuality in global information flow, problems in contemporary education and innovative technologies in foreign language learning] / N. K. Riabtseva // Linguistika i metodika prepodavania inostrannyx yasykov. [Linguistics and foreign language teaching]. - Moskva: Institute of Linguistics, Russian Academy of Sciences. - 2015. - V. 7. - P. 345-368. [Electronic resource]. URL: http://www.ihng-ran.ru/library/sborniki/for_lang/2015_07/13.pdf (accessed: 19.10.2016) [in Russian].

5. Riabtseva N. K. Sociolinguisticheskie i stilisticheskie innovacii v sovremennom kommmunikacionnom prostranstve [Sociolinguistic and stylistic innovations in contemporary communication] / N. K. Riabtseva // Profili yazyka: sociolinguistika, nazionalnoye variirovanie, perevodovedenie, kontrastivnaya stilistika. Sbornik trudov k 90-letiu A. D. Shvejzera [Language profiles: sociolinguistics, national variability, translation studies, contrastive stylistics. Festschrift to A. D. Shvejzer's 90th anniversary]. - Moskva: Institute of Linguistics, Russian Academy of Sciences. - 2015. - P. 55-62. [in Russian].

6. Riabtseva N. K. Content - connect - «texting» v novom informatsionnom prostranstve [Content - connect - texting in a new information sphere] / N. K. Riabtseva // Loghicheskiy analiz yazyka. Informacionnaya struktura textov raznyx zhanrov i epoch [Logical analysis of language. Informational structure of texts of different genres and epochs. Ed. by N. Aroutunova]. -Moskva : Indrik. - 2016. - P. 149-160. [in Russian].

7. Riabtseva, N. K. Sovremennye informatsionnye technologii i prikladnye problemy prepodavaniya inostrannyx yazykov [New information technologies and their application in foreign language learning] / N. K. Riabtseva // Prikladnaya linguistika v nauke i obrazovanii. ALPAC REPORT — 50 let posle "porazheniya" [Applied linguistics in research and education. ALPAC REPORT — 50 years after defeat. Festshrift for L.N. Belyaeva]. Trudy VIII Mezhdunarodnoy konferentsii [Proceedings of the VIII th International Conference. November 24-26, 2016]. Saint-Petersburg. - 2016. - P. 316-321. URL: https://sites.google.com/site/prikladnaalingvistika2014/sbornik-trudov-2016 (accessed 12.08.2017) [in Russian]

8. Riabtseva N. K. Yazyk I stil' internet-kommunikatsii: kognitivenyj aspekt [Language and style in internet communication: a cognitive perspective] / N. K. Riabtseva // Kognitivenoye modelirovanye. Trudy 4-go Mehzdunarodnogo foruma. Lloret de Mar, Ispaniya, Sentiabr', 11-18, 2016. Chast' 1. [The IV-th International forum on cognitive modeling (IFCM-2016). Lloret de Mar, Spain, September 11-18, 2016. Proceedings. Part I.] - Rostov-na-Donu : Fond nauki i obrazovaniya. [Rostov-on-Don: Science and Studies Foundation]. - 2016. - P. 213-222. https://elibrary.ru/item.asp?id=29083133. Forum web-site: www.confcognresearch.ru. (accessed 24.06.2017) [in Russian].

9. Riabtseva, N. K. Sovremennye informatsionnye texnologii i intellectual'nyj mir cheloveka: "From augmented reality to augmented human" ["From augmented reality to augmented human": Contemporary information technologies and their impact on human intelligence] / N. K. Riabtseva // Kognitivenoye modelirovanye. Trudy 4-go Mehzdunarodnogo foruma po kognitivnomu modelirovanyu. Lloret de Mar, Ispaniya, Sentiabr', 11-18, 2016. Chast' 2. [The IV-th International forum on cognitive modeling (IFCM-2016). Lloret de Mar, Spain, September 11-18, 2016. Proceedings. Part 2] - Rostov-na-Donu : Fond nauki i obrazovaniya. - [Rostov-on-Don : Science and Studies Foundation]. - 2016. - P. 412-421. https://elibrary.ru/item.asp?id=29083133. Forum web-site: www.confcognresearch.ru. [in Russian]

10. Riabtseva N. K. Otlischitel'nye osobennosti internet-kommunikastii v metalinguisticheskom i prikladnom aspecte [Internet communication and its essential distinctions: A metalinguistic and applied perspective] / N. K. Riabtseva // Linguistika i metodika prepodavania inostrannyx yasykov. [Linguistics and foreign language teaching]. - Moskva: Institute of Linguistics, Russian Academy of Sciences. - 2017. - V. 9. - P. 387-429. [Electronic resource]. URL: http://www.ilmg-ran.ru/library/sborniki/for_lang/2017_09/ (accessed 24.06.2017). [in Russian]

11. Jaroshevskij M. G. Uolter Kennon (1871-1945) / M. G. Jaroshevskij, S. A Chesnokova. -M.: Nauka, 1976. - 376 p. [in Russian]