文章使用ERPs技术,对比分析了汉语母语者在安静、白噪声、汉语噪声、英语噪声四种听觉条件下加工汉语句子的情况,以探究信息掩蔽条件下语义加工的神经机制。研究发现不同噪声条件下诱发的N400、LPC等ERPs成分具有不同的波形表现,据此该文得出以下结论: ①言语噪声的语言特征占用了目标声音加工所需的认知和心理资源,资源竞争导致听者对目标信号的识别能力降低,由此产生了“语言干扰”形式的信息掩蔽。②对于难度较大的语义加工,言语噪声的可懂度发挥着更关键的作用,当言语噪声为听者极其熟悉或完全陌生的语言,对语义加工的掩蔽干扰较小,当言语噪声为听者接触过的语言但不是母语或主要语言时,掩蔽效应更强。③可懂度或不确定性存在交互作用。言语噪声中出现频率较小但能够被听者理解的语义信息即为一种不确定因素,其出现与听者的预期相冲突,更容易引发听者的注意转移,加大了注意及认知资源的消耗。
Abstract
By means of ERPs, this paper explore the neural mechanism of semantic processing under information masking condition by comparing the processing of Chinese sentences in quiet condition, white noise condition, Chinese noise condition and English noise condition. It is found that the waveforms of N400, LPC and other ERPs induced by different noise conditions are different, which provide evidences for several conclusions. Firstly, the language information in speech masking occupies the cognitive and psychological resources required by the target sound processing, and the resource competition reduces the listener's ability to identify the target signals, resulting in the information masking in the form of language interference. Secondly, the speech intelligibility of the masker plays a more critical role for difficult semantic processing in the speech masking. The masking effect on semantic processing is smaller when the language is a very familiar or completely unfamiliar language, while the masking effect may be stronger when the masking noise is the non-native language to which the listener has been exposed. Finally, the listener comprehensible semantic content contained in unfamiliar speech noise that appears less frequently is more likely to trigger listener attention transfer if it conflicts with the listener expectations, which, in turn, increases information masking intensity.
关键词
信息掩蔽 /
语义加工 /
噪声类型 /
言语可懂度 /
事件相关电位
{{custom_keyword}} /
Key words
information masking /
semantic processing /
noise type /
speech intelligibility /
event-related potential
{{custom_keyword}} /
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
参考文献
[1] Shield B M,Dockrell J E. The effects of environmental and classroom noise on the academic attainments of primary school children[J]. The Journal of the Acoustical Society of America, 2008; 123(1): 133-144.
[2] Kidd G, Best V, Mason CR. Listening to every otherword: Examining the strength of linkage variables in forming streams of speech[J]. The Journal of the Acoustical Society of America, 2008; 124(6): 3793-3802.
[3] Brungart D S. Informational and energetic masking effects in the perception of multiple simultaneous talkers[J]. The Journal of the Acoustical Society of America,2001; 109(3): 2527-2538.
[4] 凝望璀璨星河: 中国智能语音行业研究报告[R]. 艾瑞咨询系列研究报告. 2020: 81-127.
[5] 杨志刚, 张亭亭, 宋耀武等.听觉信息掩蔽的亚成分: 基于行为和脑成像研究的证明[J]. 心理科学进展, 2014; 22(03): 400-408.
[6] Watson C S. Some Comments on Informational Masking[J]. Acta Acustica United with Acustica,2005; 91(3): 502-512.
[7] Cooke M,Lecumberri M, Barker J. The foreign language cocktail party problem: Energetic and informational masking effects in non-native speech perception[J]. The Journal of the Acoustical Society of America,2008; 123(1): 414-427.
[8] Neff D L, Green D M. Masking produced by spectral uncertainty with multicomponent maskers[J]. Perception & Psychophysics, 1987; 41(5): 409-415.
[9] Kidd G, Mason C R,Rohtla T L, et al. Release from masking due to spatial separation of sources in the identification of nonspeech auditory patterns[J]. Journal of the Acoustical Society of America,1998; 10(1): 422-431.
[10] Allen K,Alais D, Shinn-Cunningham B, et al. Masker location uncertainty reveals evidence for suppression of maskers in two-talker contexts[J]. The Journal of the Acoustical Society of America, 2011; 130(4): 2043-2053.
[11] Brungart D S, Simpson B D. Within-ear and across-ear interference in a dichotic cocktail party listening task: Effects of masker uncertainty[J]. Journal of the Acoustical Society of America,2004, 115(1): 301-310.
[12] Yost W A, Fay RR, Popper A N. Auditory Perception of Sound Sources[M]. New York: NY Springer US,2008: 143-189.
[13] Brungart D S.Informational and energetic masking effects in the perception of two simultaneous talkers[J]. The Journal of the Acoustical Society of America, 2001, 109(3): 1101-1109.
[14] Freyman R L, Balakrishnan U, Helfer K S. Effect of number of masking talkers and auditory priming on informational masking in speech recognition[J]. The Journal of the Acoustical Society of America, 2004, 115(5): 2246-2256.
[15] Calandruccio L, Dhar S, Bradlow AR. Speech-on-speech masking with variable access to the linguistic content of the masker speech[J]. Journal of the Acoustical Society of America, 2010, 128(2): 860-869.
[16] Van Engen KJ,Bradlow A R. Sentence recognition in native- and foreign-language multi-talker background noise[J]. Journal of the Acoustical Society of America, 2007, 121(1): 519-526.
[17] Calandruccio L, Dhar S, Bradlow A R. Speech-on-speech masking with variable access to the linguistic content of the masker speech for native and nonnative English speakers[J]. The Journal of the Acoustical Society of America,2014, 25(4): 355-366.
[18] 许家铭, 石晶, 徐波,译. 听觉系统与鸡尾酒会问题[M]. 北京: 机械工业出版社, 2021.
[19] Nakai T, Kato C, Matsuo K. An fMRI study to investigate auditory attention: A model of the cocktail party phenomenon[J]. Magnetic Resonance in Medical ences Mrms An Official Journal of Japan Society of Magnetic Resonance in Medicine, 2005,4(2): 75.
[20] Gutschalk A, Michey C, Oxenham A J. Neural Correlates of Auditory Perceptual Awareness under Informational Masking[J]. PLoS Biology, 2008, 6(6): e138.
[21] Scott S K,Mcgettigan C. The neural processing of masked speech[J]. Hearing Research, 2013, 303(9): 58-66.
[22] Dai B, Chen C, Long Y, et al. Neural mechanisms for selectively tuning into the target speaker in a naturalistic noisy situation[J]. Nature Communications,2018, 9(1): 2405.
[23] Elhilali M. Investigating bottom-up auditory attention[J]. The Journal of the Acoustical Society of America, 2016, 140(4): 3209-3209.
[24] 吕思慧, 张璐, 钟舒明等. 基于虚拟现实注意力训练对抑郁发作患者认知功能干预的研究[J]. 中华精神科杂志, 2020, 53(5): 384-391.
[25] 殷恒婵.青少年注意力测验与评价指标的研究[J]. 中国体育科技,2003,39(3): 51-53.
[26] Bennett K O, Billings C J,Molis M R , et al. Neural encoding and perception of speech signals in informational masking[J]. Ear & Hearing, 2012, 33(2): 231-238.
[27] 王振宏,姚昭.情绪名词的具体性效应: 来自ERP的证据[J].心理学报,2012,44(02): 154-165.
[28] Fields E C ,Kuperberg G R. Loving yourself more than your neighbor: ERPs reveal online effects of a self-positivity bias[J]. Social Cognitive & Affective Neuroscience, 2015,(9): 1202.
[29] 胥科, 郑芸, 孟照莉. 噪声下言语测听的影响因素[J].听力学及言语疾病杂志, 2020,28(05): 607-611.
[30] Calandruccio L, Brouwer S, Engen KV, et al. Masking release due to linguistic and phonetic dissimilarity between the target and masker speech[J]. American Journal of Audiology, 2013, 22(1): 157-164.
[31] MorayN.Attention in dichotic listening: Affective cues and the influence of instructions[J]. Quarterly Journal of Experimental Psychology, 1959, 11(1): 56-60.
[32] Conway A, Cowan N, BuntingMF.The cocktail party phenomenon revisited: The importance of working memory capacity[J]. Psychonomic Bulletin & Review, 2001, 8(2): 331-335.
[33] 李毕琴, 袁子璇, 胡竹菁. 偏差声音刺激对注意网络系统的影响[C]//中国心理学会.第十七届全国心理学学术会议论文摘要集. 中国心理学会, 2014: 951-953.
{{custom_fnGroup.title_cn}}
脚注
{{custom_fn.content}}
基金
江苏高校青蓝工程基金(20220523);国家社会科学基金(21&ZD288)
{{custom_fund}}