Human Capital Multidisciplinary Research Center

5.2.1 Neurocognitive Mechanisms of Communication and Speech

Yury Shtyrov
Project Leader

Andriy Myachykov
Project Leader

Project period

2020-2025

Context of Research Project within a Subject of Human Capital

Decision-making and information dissemination primarily take place in the communicative environment. In this regard, it is important to develop comprehensive theoretical models of the mechanisms of language and communicative function within a multimodal interface between different neurocognitive systems. This requires studying neural networks involved in the acquisition of new word forms, their meaning, as well as the ways of using them in complex sensorimotor and social contexts, studying the role of attention and perception mechanisms in language processes, understanding the mechanisms of bi- and multilingualism, language creativity, individual, variability and age-related dynamics of communicative functions.

The research project is aimed at studying the mechanisms of social communication in the context of modern ‘big challenges’, which will contribute to the development of a comprehensive theoretical model of language acquisition mechanisms, and ultimately to a deeper understanding of the human potential and the mechanisms of its formation

Project Aim

Studying the communicative function as a multimodal interface between different neurocognitive systems

Project Objectives:

  1. Developing methods for testing the impact of multilingualism on cognitive function at different ages and taking into account the individual second-language proficiency level as well as the characteristics of its use by the individual, conducting research on cognitive processes that underlie creative thinking and develop as a result of multilingual practice
  2. Analyzing individual variability of speech function brain lateralization by using functional and structural magnetic resonance imaging (MRI), transcranial magnetic stimulation taking into account the speakers’ handedness as well as other factors
  3. Developing approaches to measuring the processes of language learning in context of sensorimotor experience, studying the relationships between sensorimotor experience and word processing, clarifying the relationship between attention, sensory perception processes and linguistic behavior, identifying interactions between individual conceptual domains based on the analysis of their general relationship with the processes of attention and sensory perception within the framework of the general theory of embodied cognition
  4. Studying the general mechanisms and individual variability of the dynamics of speech function

Key Findings

2020

A range of behavioral and neurocognitive studies of speech function in different populations, as well as studies of individual variability of the representation of speech function in the brain has been prepared. New methods and approaches to the study of cognitive processes that underlie creative thinking developing as a result of multilingual practice have been developed

2021

Research data have been collected on a wide range of  topics, including sensorimotor mapping of abstract and concrete concepts To this end, the semantic priming paradigm has been used. The first experimental series included 3 experiments. Preliminary data analysis demonstrates a close link between numerical concepts and the letter length of the primed words.

Furthermore, the initial processing of white matter structural data of has been carried out, and the main white matter bundles were reconstructed in the two cerebral hemispheres (frontal-occipital tract, segments of the arcuate fascicle, inferior longitudinal fascicle, etc.), as well as corpus callosum. The main parameters of these tracts were extracted using an innovative hybrid method on structural MRI data using a sample of 50 healthy participants. The statistical analysis of the relationship between the asymmetry of functional brain activation associated with speech activity has been performed. The results indicate that the inferior frontal-occipital tract (but not the arcuate fascicle) is associated with the language lateralization in the brain

2022

The role of general systems of attention, perception and motor control in the processing of abstract concepts of time has been clarified. The data obtained show that the interaction between the sensorimotor system and the activation of time concepts begins already at the early stages of word processing

Deviations of the cursor trajectory when processing left- and right-oriented words related to the semantics of time (for example, Monday vs. Sunday). The window of statistically significant differences between conditions is highlighted in gray

2023

The relationship between the factor of family leftism and the organization of speech in the brain of healthy adults has been verified. It is known that in people whose family has lefties, speech in the brain is organized differently: not only the left, but also the right hemisphere of the brain is involved. However, until now, familial left-handedness has been taken into account in research as a binary, rather than a continuous feature. The family left-handedness index was modeled and it was shown that it is related to the organization of speech in the brain not directly, but indirectly, through personal dexterity: the family left-handedness index predicts personal dexterity, while personal dexterity partially predicts the organization of speech in the brain, as shown in previous studies.

The absence of a significant linear relationship between the index of lateralization throughout the brain and the index of family lefthandedness

Educational Programs

Experimental Linguistics Educational Module. Bachelor's Program Fundamental and Computational Linguistics

Integrated track Brain and Cognitive iBrain Sciences

Microdigree Applied Cognitive Neuroscience

Publications

  1. Bolgina T. et al. (2022)  Repetitive transcranial magnetic stimulation modulates action naming over the left but not right inferior frontal gyrus //Brain Structure and Function. – 2022. – Т. 227. – №. 8. – С. 2797-2808. doi
  2. Malyshevskaya A. et al. (2023). Mapping of individual time units in horizontal space //Language and Cognition. – 2023. – Т. 15. – №. 2. – С. 245-265. doi
  3. Shtyrov Y. et al. (2023) Breakdown of category-specific word representations in a brain-constrained neurocomputational model of semantic dementia //Scientific Reports. – 2023. – Т. 13. – №. 1. – С. 19572. doi
  4. Wang Y., Wei L. (2023) Multilingual learning and cognitive restructuring: The role of audiovisual media exposure in Cantonese–English–Japanese multilinguals’ motion event cognition //International Journal of Bilingualism. – 2023. – Т. 27. – №. 3. – С. 331-348. doi
  5. Bermúdez-Margaretto B. et al. (2023) Neural correlates of cross-alphabetic interference and integration in the biliterate brain //Bilingualism: Language and Cognition. – 2023. – С. 1-14. doi
  6. A.Erzhanova, A. Kharkhurin, V. Koncha. The Influence of Big Five Personality Traits on Foreign Language Classroom Anxiety Psychology. Journal of the Higher School of Economics. 2024. Vol. 21. N 1. P. 184–201. DOI: 10.17323/1813-8918-2024-1-184-201

RIA

Dragoi O.V., Zontov Yu.V., Zubareva N.D. Computer Program "Multilingual Intraoperative Nominative Test (MINT)". Certificate of state registration of the computer program No. 2023665887 dated 07/21/2023

Conferences

Eighth Summer Neurolinguistic School The Science of Reading: from the Brain to Behavior and Back (Moscow, Russia, June 28-30, 2021)

Ninth Summer Neurolinguistic School Experimental Studies of Ethnic Languages of Russia (Moscow, Russia, June 27-28, 2022)

First International Conference Cross-Cultural Aspects of Bilingualism (Moscow, Russia, September 30, 2022)

XXIV Yasin (April) International Scientific Conference on Problems of Economic and Social Development(Moscow, Russia, April 4-14, 2023):

- Exhibition "Anthropological and neurocognitive clusters – an environment for breakthrough scientific research!" HSE and IEA RAS 

- Honorary report by Jubin Abutalebi "Prevention of dementia through bilingualism" (06/04/2023)

10th International Summer Neurolinguistic School "Eytracking for Science and Life" (in English) (Moscow, Russia, September 18-20, 2023)

VK Science Community Festival (Moscow, Russia, September 23, 2023 d.):

- Interactive stands "Neurocognitive cluster – an environment for breakthrough scientific research"

International School of Neurolinguistics "From idea to publication" (Moscow, Russia, September 26-28, 2023)

All-Russian Festival "Science 0+" (Moscow, Russia, October 7, 2023):

– Interactive stands "Neurocognitive cluster - environment for breakthrough scientific research"

International School on Brain Mechanisms of Communication and Language"From ideas before publication"(Moscow, Russia, November 15-17, 2023)