隱性注意下視聽(tīng)雙通道腦控字符輸入系統(tǒng)關(guān)鍵問(wèn)題研究
發(fā)布時(shí)間:2018-05-26 17:56
本文選題:隱性注意 + 視聽(tīng)聯(lián)合 ; 參考:《天津大學(xué)》2015年博士論文
【摘要】:腦控字符輸入系統(tǒng)可以幫助重癥殘障病人通過(guò)虛擬鍵盤(pán)信息實(shí)現(xiàn)對(duì)外自主交流,但傳統(tǒng)的顯性注意輸入范式很大程度上依賴(lài)于使用者的注視轉(zhuǎn)移水平,并不適用于眼動(dòng)控制受限的重癥殘障病人。為了解決這一問(wèn)題,研究者逐漸轉(zhuǎn)向?qū)で笠恍┗陔[性注意的腦機(jī)交互新方法,尤其是在視覺(jué)與聽(tīng)覺(jué)雙通路聯(lián)合刺激方面給予了較高期望,相應(yīng)研究亟待深入開(kāi)展;谏鲜霰尘,本文首先設(shè)計(jì)了三類(lèi)獨(dú)立于眼動(dòng)控制的隱性注意刺激范式,分別是:視覺(jué)刺激范式、聽(tīng)覺(jué)刺激范式以及視聽(tīng)聯(lián)合刺激范式。通過(guò)對(duì)不同刺激范式誘發(fā)出的事件相關(guān)電位各成分特征、分類(lèi)正確率的時(shí)空分布特性以及溯源結(jié)果的分析,探究了視覺(jué)刺激和聽(tīng)覺(jué)刺激在不同控制條件下的作用機(jī)制和大腦對(duì)不同刺激范式的響應(yīng)特性,并且通過(guò)對(duì)在線字符輸入速度和實(shí)驗(yàn)中任務(wù)負(fù)荷的分析,證明了視聽(tīng)聯(lián)合刺激范式是一種低任務(wù)負(fù)荷的高效字符輸入范式。在此基礎(chǔ)上,研究中設(shè)計(jì)并實(shí)現(xiàn)了五種視-聽(tīng)呈現(xiàn)時(shí)間差的視聽(tīng)聯(lián)合刺激范式下的隱性注意腦控字符輸入系統(tǒng)。通過(guò)對(duì)其誘發(fā)出的事件相關(guān)電位進(jìn)行分析發(fā)現(xiàn),視聽(tīng)聯(lián)合刺激早期成分與視覺(jué)和聽(tīng)覺(jué)均顯著相關(guān),而事件相關(guān)電位的潛伏期主要與視覺(jué)刺激的呈現(xiàn)時(shí)刻相關(guān)。呈現(xiàn)時(shí)間差在一定范圍內(nèi)(小于100 ms)的視-聽(tīng)聯(lián)合刺激范式均可取得較高的分類(lèi)正確率,且不存在顯著性差異。這一方面顯示了文中采用的分類(lèi)算法的魯棒性,另一方面也說(shuō)明只要保證視-聽(tīng)刺激的刺激呈現(xiàn)時(shí)間差在一定范圍內(nèi)并配以合適的分類(lèi)器就可以得到較高的分類(lèi)正確率,而不必對(duì)硬件系統(tǒng)和配準(zhǔn)時(shí)刻有過(guò)高的要求。最后本文還提出了一種新穎的隱性注意視聽(tīng)雙通道刺激范式,即視聽(tīng)并行刺激范式。實(shí)現(xiàn)了利用視覺(jué)刺激與聽(tīng)覺(jué)刺激并行完成對(duì)目標(biāo)任務(wù)的選擇。文中從事件相關(guān)電位的特性與分類(lèi)識(shí)別的結(jié)果分析了視聽(tīng)并行字符輸入的可能性,結(jié)果表明并行范式下可誘發(fā)產(chǎn)生穩(wěn)定的事件相關(guān)電位,并具有較強(qiáng)的可分性。有超過(guò)70%的被試可以達(dá)到輸入字符正確率在80%以上?傊,本文設(shè)計(jì)實(shí)現(xiàn)了多種隱性注意視聽(tīng)刺激范式,探討了視聽(tīng)聯(lián)合刺激中視覺(jué)刺激與聽(tīng)覺(jué)刺激的作用機(jī)制,并證明了視聽(tīng)聯(lián)合刺激范式的優(yōu)勢(shì)及視聽(tīng)并行刺激范式的可行性,研究成果有望在重癥癱瘓腦-機(jī)接口康復(fù)系統(tǒng)中得到進(jìn)一步的推廣應(yīng)用。
[Abstract]:The brain-controlled character input system can help the severely disabled patients to communicate autonomously through virtual keyboard information, but the traditional explicit attention input paradigm largely depends on the user's fixation transfer level. Not suitable for severely disabled patients with limited eye movement control. In order to solve this problem, researchers have gradually turned to seek some new methods of brain-computer interaction based on recessive attention, especially in the combination of visual and auditory stimuli. Based on the above background, three types of implicit attention stimuli are designed, which are visual stimulation paradigm, auditory stimulus paradigm and audio-visual combined stimulation paradigm. The characteristics of the components of event-related potentials induced by different stimulus paradigms, the temporal and spatial distribution of classification accuracy and the traceability results were analyzed. This paper explores the mechanism of visual and auditory stimuli under different control conditions and the characteristics of brain response to different stimuli patterns, and analyzes the speed of online character input and the task load in the experiment. It is proved that the Audio-visual combined stimulation paradigm is an efficient character input paradigm with low workload. On the basis of this, we design and implement five implicit attention control character input systems under the visual and auditory time-delay combined stimulation paradigm. It was found that the early components of the combined audiovisual stimulation were significantly related to the visual and auditory components, while the latency of the event-related potentials was mainly related to the presentation time of the visual stimuli. In a certain range (less than 100 Ms), the visual and auditory stimulus paradigm with time difference can achieve a higher classification accuracy, and there is no significant difference. On the one hand, it shows the robustness of the classification algorithm used in this paper. On the other hand, it also shows that the classification accuracy can be obtained by ensuring that the time difference of visual and auditory stimuli is within a certain range and matching with a suitable classifier. There is no need for the hardware system and registration time to have too high requirements. Finally, this paper proposes a novel implicit attention audiovisual dual channel stimulation paradigm, that is, audiovisual parallel stimulation paradigm. The choice of target task by visual stimulation and auditory stimulation is realized. In this paper, the possibility of audio-visual parallel character input is analyzed from the characteristics of event-related potentials and the results of classification and recognition. The results show that the event-related potentials can be induced in parallel paradigm and have strong separability. More than 70% of the subjects can achieve the input character accuracy of more than 80%. In a word, this paper designs and implements a variety of implicit audio-visual stimulation paradigms, probes into the mechanism of visual stimulation and auditory stimulation in combination with audio-visual stimulation, and proves the advantages of audio-visual co-stimulation paradigm and the feasibility of audio-visual parallel stimulation paradigm. The research results are expected to be further applied in the rehabilitation system of severe paralysis brain-computer interface.
【學(xué)位授予單位】:天津大學(xué)
【學(xué)位級(jí)別】:博士
【學(xué)位授予年份】:2015
【分類(lèi)號(hào)】:R496;TH789
【相似文獻(xiàn)】
相關(guān)期刊論文 前2條
1 葛霽光;沈公羽;;動(dòng)態(tài)心電快速分析系統(tǒng)的研制[J];醫(yī)療器械;1987年04期
2 ;[J];;年期
相關(guān)會(huì)議論文 前1條
1 蔡?hào)|亦;陳志瑋;張哲榮;陳建智;利德江;;藉由虛擬樣本改善集成法的分類(lèi)正確率[A];第25屆全國(guó)灰色系統(tǒng)會(huì)議論文集[C];2014年
相關(guān)博士學(xué)位論文 前2條
1 安興偉;隱性注意下視聽(tīng)雙通道腦控字符輸入系統(tǒng)關(guān)鍵問(wèn)題研究[D];天津大學(xué);2015年
2 葉檸;基于腦電信號(hào)的腦—機(jī)接口的關(guān)鍵技術(shù)與實(shí)驗(yàn)研究[D];東北大學(xué);2010年
相關(guān)碩士學(xué)位論文 前2條
1 單外平;基于深度信念網(wǎng)絡(luò)的變速器故障分類(lèi)識(shí)別研究[D];華南理工大學(xué);2015年
2 李南南;N-back誘發(fā)腦力負(fù)荷信息檢測(cè)與識(shí)別技術(shù)研究[D];天津大學(xué);2014年
,本文編號(hào):1938289
本文鏈接:http://sikaile.net/huliyixuelunwen/1938289.html
最近更新
教材專(zhuān)著