【摘要】：該文系統(tǒng)地研究了中國手語模態(tài)對句子加工的影響,使用事件相關(guān)電位(ERP)技術(shù)來探索句子加工過程中手勢模態(tài)的語義和語音信息對詞匯通達(dá)的影響和時(shí)間過程。設(shè)計(jì)實(shí)驗(yàn)材料時(shí),對句尾變化條件下目標(biāo)手勢的語義和音韻形式進(jìn)行了系統(tǒng)的人為操縱。通過18個(gè)被試的實(shí)驗(yàn),觀察到將初級視覺特征映射到手勢音韻特征的手勢感知證據(jù)(時(shí)長100~200ms),緊接著是將目標(biāo)手勢音韻特征與語境信息匹配的負(fù)成分(時(shí)長200~400ms),以及表征語篇語境對語義制約的動態(tài)建構(gòu)的負(fù)成分(時(shí)長400~650ms),它促進(jìn)了手勢的音義信息與句子信息的整合。音近和義近手勢在時(shí)間進(jìn)程和效應(yīng)方向上存在著相似性,表明手語模態(tài)的詞匯通達(dá)與有聲語言類似,并消耗類似的在線處理成本。同時(shí)發(fā)現(xiàn)了手語模態(tài)獨(dú)有的表征手語音韻特征加工已經(jīng)完成的N300效應(yīng),它代表了手勢音韻元素識別和手勢識別之間的直接聯(lián)系。實(shí)驗(yàn)結(jié)果表明:在進(jìn)行句子加工時(shí),被試首要考慮的是語境和目標(biāo)手勢匹配,并不是與手勢的音韻特征匹配。這種結(jié)果可能是詞匯選擇時(shí)音近和義近相關(guān)信息相互作用的標(biāo)志。
[Abstract]:In this paper, the effects of Chinese sign language modes on sentence processing are systematically studied. The Event-related potential (ERP) technique is used to explore the semantic and phonological effects of gesture modes and phonological information on lexical access in sentence processing. When designing experimental materials, the semantic and phonological forms of target gestures are systematically manipulated. Through the experiments of 18 subjects, we observed the gestural perception evidence (100~200ms) which mapped primary visual features to gesture phonological features, followed by negative components (time-length 200~400ms), which matched the phonological features of target gestures with contextual information. And the negative component (400~650ms), which characterizes the dynamic construction of semantic constraints in discourse context, promotes the integration of phonological and sentence information of gestures. There are similarities in time process and effect direction between near and semantic gestures, which indicates that the lexical accessibility of sign language mode is similar to that of sound language, and the online processing cost is similar. At the same time, the N300 effect, which is unique to sign language modal, is found to represent the N300 effect, which represents the direct relationship between gesture rhyme element recognition and gesture recognition. The experimental results show that the context and target gesture matching is the primary consideration in sentence processing, but not with the phonological feature of the gesture. This result may be a sign of the interaction between phonological and semantic information in lexical selection.
【作者單位】： 清華大學(xué)人文學(xué)院計(jì)算語言學(xué)實(shí)驗(yàn)室;清華大學(xué)心理學(xué)與認(rèn)知科學(xué)研究中心;北京市信息服務(wù)工程重點(diǎn)實(shí)驗(yàn)室(北京聯(lián)合大學(xué));
【基金】：國家自然科學(xué)基金重大項(xiàng)目(91420202);國家自然科學(xué)基金重點(diǎn)項(xiàng)目(61433015) 國家社會科學(xué)基金重大項(xiàng)目(14ZDB154) 教育部人文社會科學(xué)研究規(guī)劃基金青年項(xiàng)目(14YJC740104) 清華大學(xué)自主科研項(xiàng)目兩岸清華大學(xué)專項(xiàng)(20161080056)
【分類號】：H126.3
，

本文編號：2413895