From The Journals

Why Haven't Large Language Models "Killed" Psychology?

[:en]Why Haven't Large Language Models "Killed" Psychology?[:]

Observations

How to Bridge the Gap Between Artificial Intelligence and Human Intelligence?

[:en]How to Bridge the Gap Between Artificial Intelligence and Human Intelligence?[:]

A Quiet Revolution: How Focused Ultrasound is Redefining Non-Invasive Brain Treatment

[:en]A Quiet Revolution: How Focused Ultrasound is Redefining Non-Invasive Brain Treatment[:]

What Will Future Life Forms Look Like?

[:en]What Will Future Life Forms Look Like?[:]

Acupuncture: The Revival of Ancient Wisdom in Modern Neuroscience

[:en]Acupuncture: The Revival of Ancient Wisdom in Modern Neuroscience[:]

Latest News

Interviews With Scientists

Interview with Prof. Moritz Helmstaedter: The decade-long debate has concluded, Has the European Brain Project failed?

[:en]Interview with Prof. Moritz Helmstaedter: The decade-long debate has concluded, Has the European Brain Project failed?[:zh]十年争议落幕，欧洲脑计划失败了吗？｜追问专访·Moritz Helmstaedter[:]

Interview with Professor Si Wu: Unlocking the "Door of Wisdom" in Artificial Intelligence

[:en]Interview with Professor Si Wu: Unlocking the "Door of Wisdom" in Artificial Intelligence[:zh]吴思：打开人工智能的“智慧之门”[:]

Interview with Prof. Wang Xiaojing: Fostering interdisciplinary talents for computational neuroscience

[:en]Interview with Prof. Wang Xiaojing: Fostering interdisciplinary talents for computational neuroscience[:zh] 汪小京 · 为计算神经科学培养跨学科人才[:]

Deep within the human brain, there&#8217;s a fascinating phenomenon that has captivated us for centuries—an intricate interplay between music and the brain. From soothing lullabies to exhilarating symphonies, music possesses boundless power to evoke emotions, ignite creativity, and offer us diverse sensory experiences.
&nbsp;
Scientists are currently dedicated to unraveling the mystery of how music influences human neural circuits, shedding light on its impact on various regions and functions of the brain. We are honored to have invited Professor Du Yi from Institute of Psychology, Chinese Academy of Sciences, to explore the effects of music on the brain from an anti-aging perspective.
<img loading="lazy" decoding="async" class="aligncenter wp-image-787" src="https://admin.next-question.com/wp-content/uploads/2023/11/1699193665366.png" alt="" width="600" height="274" srcset="https://admin.next-question.com/wp-content/uploads/2023/11/1699193665366.png 717w, https://admin.next-question.com/wp-content/uploads/2023/11/1699193665366-300x137.png 300w" sizes="auto, (max-width: 600px) 100vw, 600px" />
&nbsp;
<h4>Question: Please briefly introduce your research background.</h4>
&nbsp;
Professor Du: I took my undergraduate courses in medicine, but when it came to choosing my doctoral program, I developed a strong interest in psychology, especially in unraveling the mysteries of human brains. Consequently, I switched to a Ph.D. program in psychology. During my doctoral studies, my research primarily focused on auditory studies using rats as subjects, encompassing both physiological and behavioral research. However, in the later stages of my Ph.D. program and during my postdoctoral research, I became increasingly fascinated by the human brain and its processing of advanced auditory signals, such as language and music. As a result, after establishing my own laboratory, I have been dedicated to researching how the human brain comprehends language, appreciates music, and the neural mechanisms underlying these processes.
&nbsp;
As people age, the structure and function of the brain will degenerate. One significant change that impacts the quality of life for the elderly is the deterioration of hearing. In noisy environments like streets or restaurants, it becomes increasingly challenging for the elderly to discern what others are saying. This not only affects their social interactions but also their emotional well-being and even cause premature dementia. Therefore, we are deeply interested in understanding how the elderly manage speech comprehension in such noisy settings and whether they employ additional cognitive mechanisms for this purpose.
&nbsp;
In a paper we published in Nature Communications in 2016, we discovered that despite the decline in perceptual processing abilities among the elderly, they tend to engage additional brain regions, particularly those associated with speech motor control, to actively predict what others will say. This proactive, top-down prediction mechanism helps the elderly better compensate for their declining perceptual abilities, enabling them to comprehend language more effectively, especially in complex environments.
&nbsp;
Building upon this background, in our study published in PNAS in 2017, we found that young individuals, particularly young musicians, excel at speech comprehension in complex environments. We were interested in uncovering the underlying neural mechanisms, and our results revealed that young musicians possess stronger perceptual-motor integration capabilities. They rely not only on auditory input but also on predicting and compensating for speech motor movements and integrating cross-modal information to aid their speech comprehension in intricate environments.
&nbsp;
These two studies suggest a potential connection between perception and motor. It appears that the elderly may rely more on advanced, top-down perceptual-motor predictions and integration, while young musicians, attributable to their musical training experience, have advatanges in utilizing perceptual-motor integration for speech comprehension. Naturally, this leads us to inquire whether the elderly, through systematic musical training, can also enhance their cross-modal information integration abilities. Will such training potentially aid them in improving their speech comprehension within complex environments?
&nbsp;
Based on this premise, we embarked on a series of subsequent studies and found that compared to elder non-musicians, elder musicians are better at speech perception in noisy environments. In 2021, we published related behavioral research in Ear and Hearing, and followed up with new studies whose most recent findings have been published in Science Advances.
&nbsp;
<h4>Question: You mentioned that you recently published a study in Science Advances. Could you please introduce the new findings from this research?</h4>
&nbsp;
Professor Du: The recently published study in Science Advances is a featured cover article. We recruited three groups of subjects: one consisted of young non-musicians as a control group, but our primary focus was on the other two groups—elder non-musicians and elder musicians.
&nbsp;
We had them perform a visual-auditory speech syllable discrimination task in noisy environment, while monitoring their brain activity using fMRI. They would hear different syllables while simultaneously viewing matching lip movements on a screen. Their task was to determine what exactly they have heard against background noise of varying intensities.
&nbsp;
We found that behaviorally, the performance of elder musicians was closer to that of young individuals, with no significant differences in their performance, even in moderate and light noise backgrounds. In other words, musical training experience can assist the elderly in achieving performance similar to that of young individuals. This finding leads to the question: what are the underlying mechanisms?
&nbsp;
Firstly, compared to elder non-musicians, elder musicians exhibited neural processing patterns (also known as representation patterns) that were more similar to those of young individuals in both the left and right perceptual-motor regions when processing syllables in noisy environment. Sometimes, there’s even no significant differences between the two groups. In fact, their performance was significantly better than that of elder non-musicians who displayed a noticeable decline in distinguishing different speech sounds compared to young individuals. Their brains struggled to distinguish between, for example, “ba” and “da”. In contrast, elder musicians maintained strong neural differentiation abilities, similar to young individuals. This indicates that musical training experience can enhance and rejuvenate brain function which we refer to as functional preservation.
&nbsp;
Furthermore, we also discovered that elder musicians, in contrast to elder non-musicians, activated a broader range of brain regions within the frontoparietal network. These brain regions are associated with working memory and cognitive control. This suggests that elder musicians are capable of engaging more advanced brain regions for behavioral compensation.
&nbsp;
Simultaneously, elder musicians exhibited greater suppression of a brain region known as the angular gyrus compared to elder non-musicians. As a core component of the default brain network, angular gyrus is associated with autobiographical memory and long-term memory. Therefore, it tends to be activated when we are not engaged in specific tasks and relatively suppressed when we perform cognitive tasks. When we engage in cognitive tasks that require our attention to external stimuli, it becomes necessary to suppress brain regions in default network to prevent them from interfering.
&nbsp;
We found that elder musicians excel at suppressing this brain region, indicating their ability to focus more attentively on external stimuli and suppress irrelevant information. This enhanced suppression also assists them in achieving better behavioral performance. Elder musicians achieve improved performance by employing additional activation or inhibition of certain brain regions, a mechanism referred to as functional compensation.
&nbsp;
This mechanism is related to the first one mentioned earlier &#8212; functional preservation. We found that these two mechanisms are interconnected and mutually influence each other. When an elderly possess stronger abilities to activate the frontoparietal network and to inhibit the angular gyrus, his/her neural representation in the perceptual-motor brain regions also improves, rejuvenated to the level of young individuals. This suggests that functional compensation can support enhanced functional preservation. Based on these two mechanisms, musical training experience can assist elder individuals in speech perception in noisy environments and improve their behavioral performance.
<img loading="lazy" decoding="async" class="aligncenter wp-image-784" src="https://admin.next-question.com/wp-content/uploads/2023/11/81.png" alt="" width="600" height="761" srcset="https://admin.next-question.com/wp-content/uploads/2023/11/81.png 1080w, https://admin.next-question.com/wp-content/uploads/2023/11/81-237x300.png 237w, https://admin.next-question.com/wp-content/uploads/2023/11/81-808x1024.png 808w, https://admin.next-question.com/wp-content/uploads/2023/11/81-768x974.png 768w" sizes="auto, (max-width: 600px) 100vw, 600px" />
<h4>Question: Based on your research, how often does one need to play a musical instrument to potentially help preserve cognitive function and counteract the negative effects of aging?</h4>
&nbsp;
Professor Du: In this study, we asked the elderly to maintain a minimum of one hour of training per week within the last three years. Although they self-reported a substantial training frequency over the preceding three to four decades, it was challenging to track their training durations during the 1960s and 1970s due to historical reasons. Therefore, our focus was solely on the training frequency in the most recent three years.
&nbsp;
<h4>Question: Is it possible to achieve cognitive protection effects through temporary practice if one had no prior experience in playing a musical instrument?</h4>
&nbsp;
Professor Du: That&#8217;s a great question. What we&#8217;re currently conducting is a cross-sectional study where we directly compare the elderly with long-term musical training to those without such experience to observe differences, and we have found some. Additionally, there are numerous other longitudinal studies, both long-term and short-term, indicating that brief periods of musical training lasting from three to six months can also enhance language processing abilities for the elderly.
&nbsp;
<h4>Question: Can we achieve the same effects by listening to music?</h4>
&nbsp;
Professor Du: We all hope that passive music listening can yield similar positive effects, but current findings do not allow us to draw that conclusion definitively. Our study focuses on the effects of actively engaging in musical training, which involves multiple systems including visual, auditory, motor, emotional, and attentional processes. This multi-system engagement may have a more pronounced impact. However, listening to music also has its own benefits, such as mood regulation, stress relief, and potential improvement of focus and attention.
&nbsp;
<h4>Question: The participants in your study were engaged in a visual-auditory syllable discrimination task. Have you considered conducting other types of tasks?</h4>
&nbsp;
Professor Du: Both musicians and non-musicians in our study have completed other types of tasks. One of these tasks involved auditory working memory, where participants were presented with sequences of numbers of varying lengths and asked to repeat them in the original order or reversed order. Additionally, we assessed their executive control abilities, including the classic Stroop effect (the interference of literal meaning in font color).
&nbsp;
We found that elder musicians exhibited superior auditory working memory compared to elder non-musicians. While we didn&#8217;t observe better performance in cognitive control tasks like the Stroop effect in our study, it&#8217;s noteworthy that other research has indicated that musical experience can enhance working memory and executive control capabilities.
&nbsp;
The reason why we conducted the visual-auditory syllable discrimination task in our study was that speech processing involves real-time processing for everyone, and identifying consonants, vowels, and tones is crucial for recognition. Therefore, syllable discrimination tasks serve as a fundamental unit for speech processing.
&nbsp;
<h4>Question: Compared to non-musicians, musicians exhibit superior speech perception abilities in noisy environments. Do you believe this is solely attributable to their musical training, or could there be other factors at play?</h4>
&nbsp;
Professor Du: We chose musical training for our study because it represents a multi-system training approach that is relatively enjoyable. Moreover, it has been associated with improvements in various cognitive functions, such as working memory, selective attention, and cognitive control, among others. This includes findings from our research: stronger inhibition of the default brain network and enhanced modulation of the frontoparietal attention network among musicians. Therefore, we believe it is likely associated with musical training.
&nbsp;
However, since our study is cross-sectional, it&#8217;s important to acknowledge that there may be other differences between musicians and non-musicians in various aspects, and we cannot definitively rule out whether these differences are caused by innate factors or acquired ones.
&nbsp;
It&#8217;s possible that some individuals become musicians because of better innate structural and functional foundations or other traits that guide them toward a musical path. Therefore, our current cross-sectional study cannot definitively confirm the involvement of other factors, especially personal traits that might contribute to superior speech processing abilities. To address this question, conducting a longitudinal study would be ideal to establish whether these effects are indeed the results of musical training.
&nbsp;
<h4>Question: Are there any other studies examining similar topics? If so, are there any similarities and discrepancies between those studies and yours?</h4>
&nbsp;
Professor Du: Many researchers have indeed investigated whether musical training can assist the elderly in improving their speech perception, and they have found similar results at the behavioral level. What sets our new study apart from theirs is that we were able to identify cognitive neural mechanisms supporting both functional preservation and compensation in the brain. This allowed us to provide better explanation in terms of mechanisms to improved behavioral performance.
&nbsp;
<h4>Question: Has this study shed new light on anti-aging and brain health? Are there potential clinical application value of the findings, such as developing targeted interventions or treatment methods to enhance speech perception or other cognitive abilities among the elderly?</h4>
&nbsp;
Professor Du: We believe that musical training can have a neuroprotective effect on the brain by bringing it back to youth.
&nbsp;
While our study focused on the effects of long-term musical training, in the future, we are interested in investigating the minimum durations and frequencies of training that might also yield similar outcomes.
&nbsp;
This also reminds us that regardless of age, if you can start learning a musical instrument or even singing as early as possible, it may potentially slow down the aging process of the brain. Therefore, we currently advocate for the general public to consider learning music if plausible and to start engaging with music.
&nbsp;
In terms of clinical value, we are interested in exploring whether music therapy could be employed in the context of certain cognitive degenerative disorders among the elderly, such as Alzheimer&#8217;s disease, to improve their memory and language abilities.
&nbsp;
<h4>Question: Could music-based games potentially have similar effects?</h4>
&nbsp;
Professor Du: That&#8217;s a great approacg. Games like Rhythm Master can be effective training methods. We also refer to this as digital therapy. Using music as a form of digital therapy holds great promise for the future because gamified training like this is undoubtedly more intriguing and appealing for the elderly get fully engaged.
&nbsp;
Interviewed &amp; Edited by: Ashley Wang 
Proofread by: Xu Yunke

Interview with Prof. Du Yi: Can music rejuvenate the brain

[:en]Interview with Prof. Du Yi: Can music rejuvenate the brain[:zh]杜忆 · 音乐让大脑“返老还童”？[:]

Interview with Prof. Wu Mengyue: Do machines understand sounds better than humans?

[:en]Interview with Prof. Wu Mengyue: Do machines understand sounds better than humans?[:zh]吴梦玥 · 机器比人类更会理解声音吗？[:]

rectangle-68

Rectangle 68

NextQuestion Interviews

rectangle-63-1

Rectangle 63 (1)

NextQuestion Spotlight

nq_social_banner_en_112823

NQ_Social_Banner_EN_112823

How Does the Large Language Model Proclaim the Death of Psychology?

[:en]How Does the Large Language Model Proclaim the Death of Psychology?[:zh]万字长文，大语言模型如何宣告心理学的死亡?[:]

Ultrasound Telepathy: A New Breakthrough! Utilizing Intent to Control Direction, Achieving 'Precognition without Motion'

[:en]Ultrasound Telepathy: A New Breakthrough! Utilizing Intent to Control Direction, Achieving 'Precognition without Motion'[:zh]“超声读心”新突破！用意念控制方向，实现“未动先知”[:]

It has taken decades for computer scientists to finally materialize automatic speech recognition AI models that are closer to the human level. Such purely engineered AI models have completely abandoned earlier modeling frameworks based on linguistic theory, and entirely adopted data-driven, end-to-end, large-scale pre-trained deep neural networks. So how much does such a model resemble the auditory pathways of the human brain?
&nbsp;
To address this issue, Professor Yuanning Li&#8217;s team at the School of Biomedical Engineering, ShanghaiTech University, in collaboration with Professor Edward Chang at the University of California, San Francisco, and Professor Jinsong Wu/Junfeng Lu&#8217;s team at Fudan University, integrated a variety of technological approaches such as self-supervised pre-trained in-depth speech modeling, high-density intracranial electroencephalograms, and single-neuron simulation modeling, and thoroughly investigated the computational and representational similarities between AI speech models and the auditory pathways of the human brain utilizing a cross-language (English and Chinese) control experiment paradigm.
&nbsp;
Researchers can extract features at different levels &#8211; from purely acoustic spectrogram features to phonetic vowels and consonants and articulations, to relative pitches containing contextual information, etc. &#8211; and then use sliding time windows to predict neural responses. If a particular type of feature accurately predicts neural activity in a particular region, it is usually assumed that the neural activity encoded in that region expresses that type of feature.
&nbsp;
Over the past decade or so, using intracranial electrophysiological recording experiments as well as neural coding models, researchers have identified several important features of neural coding, e.g., the activity of different neural populations in the secondary auditory cortex of the superior temporal gyrus encodes features ranging from envelopes of voice to specific vowel and consonant phonemes, and so on.
&nbsp;
In this study, in addition to the secondary auditory cortex, which is closely related to speech, using intracranial high-density EEG recording technology and high-precision single-neuron biophysical simulation modeling, the researchers obtained neural responses covering the entire auditory pathway from the auditory nerves to the brainstem to the auditory cortex.
&nbsp;
Given that AI models and brain auditory circuits are capable of receiving the same speech input and performing similar cognitive functions, are there computational and representational similarities between the two? This is the key question on which this study focuses.
&nbsp;
To address this problem, the researchers have constructed a new deep neural coding model. This is a purely data-driven model that extracts feature representations from deep neural networks pre-trained with speeches, applies these data-driven features to construct a new linear coding model, and performs correlation analysis with authentic brain auditory response signals to investigate the similarity between the intrinsic feature representations of deep neural networks and the activities of different neural populations within the brain auditory pathway.
&nbsp;
By comparing the performance of neural activity prediction at different nodes of the auditory pathway of the neural coding models built based on these models, it was found that there is indeed a great similarity between the hierarchical structure of the end-to-end speech pre-training network, and that of the auditory circuit.
&nbsp;
First, for the entire auditory pathway, the encoding prediction model based on deep neural network features is comprehensively better than the traditional linear feature model based on linguistic theory. This indicates that the entire auditory pathway has strong nonlinear features. Second, models with different levels of complexity correspond to different regions in the auditory pathway. In addition, it was found that for the same self-supervised speech model, its overall hierarchical structure corresponds to the AN-IC-STG hierarchical structure of the auditory pathway.
&nbsp;
Having established the representational similarities between the deep speech model and the auditory pathway, the researchers further explored the computational mechanisms driving these representational similarities, focusing on the best-performing HuBERT model.
&nbsp;
The results show that as the network deepens, the attentional weights aligned to long-range contextual structures become progressively larger. It is worth emphasizing that the HuBERT model used here is fully self-supervised, and the training process does not include any explicit information about the context structure as well as the speech content information. This result suggests that a self-supervised trained speech model can learn key context structure information related to language and semantics in natural speech.
&nbsp;
In the secondary auditory cortex of the superior temporal gyrus, which is closely related to speech processing, the higher the alignment of the self-attentional weights with the contextual structures in speech, the better the neural network&#8217;s prediction of brain activity, while conversely, in the primary auditory cortex as well as in these regions of the auditory nerve and brainstem, the greater the expression of localized transient information in the temporal domain, and the greater the resemblance between neural networks and brain signals.
&nbsp;
Last but not least, the study further analyzed whether the self-supervised model was able to learn more advanced contextual information. The results show that the self-supervised model is able to learn higher-level contextual information related to linguistic specificity and that this specificity information is significantly correlated with computation and representation in the phonetic cortex of the brain.
&nbsp;
This study provides a new biological perspective on unlocking the “black box” of deep neural networks, especially the self-attention model called Transformer.
&nbsp;
<a href="https://www.nature.com/articles/s41593-023-01468-4">Read the paper on Nature Neuroscience</a>

How similar are AI speech models to the auditory pathways of humans?

[:en]How similar are AI speech models to the auditory pathways of humans?[:zh]AI语音模型与人的听觉有多相似？上科大/UCSF/复旦联合团队解析深度语音模型与人脑听觉通路的表征与计算相似性[:]

Because the Mountain is There - A Decade of Human Brain Projects

[:en]Because the Mountain is There - A Decade of Human Brain Projects[:zh]因为山就在那里——人类脑计划的十年[:]

Embodied Intelligence: The Pathway to the Future of Human Wisdom

[:en]Embodied Intelligence: The Pathway to the Future of Human Wisdom[:zh]具身智能：通向人类智慧的未来之路[:]

Why does the brain play a single song on a loop? 
Can listening to more music improve children's cognition?