本文選題：虛擬現(xiàn)實(shí) + 人機(jī)交互��； 參考：《山東大學(xué)》2017年碩士論文

【摘要】：隨著虛擬現(xiàn)實(shí)技術(shù)的快速發(fā)展,虛擬現(xiàn)實(shí)影院開始出現(xiàn),其中一類虛擬現(xiàn)實(shí)影院就是近年出現(xiàn)的虛擬射擊影院。目前流行的虛擬射擊影院支持很多觀眾坐在動感座椅上、戴著立體眼鏡、并端著游戲槍對大屏幕顯示內(nèi)容進(jìn)行射擊。這類射擊影院可以使觀眾有很強(qiáng)的沉浸感體驗(yàn)。而且,相較于戴VR頭盔進(jìn)行協(xié)同射擊游戲的模式,更具共同存在感。射擊識別系統(tǒng)是虛擬射擊影院的核心部分。目前的射擊識別系統(tǒng)大部分采用基于計(jì)算機(jī)視覺識別的交互方法。這類系統(tǒng)普遍存在不支持多人、交互范圍受限等缺陷。近年來,由于傳感器技術(shù)的快速發(fā)展,傳感器種類越來越多,價(jià)格越來越便宜,精度越來越高。開始出現(xiàn)了一些基于MEMS(Micro-Electro-Mechanical System)傳感器的交互裝置和方法,其中包括一些射擊交互設(shè)備。相較于基于計(jì)算機(jī)視覺的方法,這類方法具有不受攝像頭相關(guān)參數(shù)的限制,成本較低等優(yōu)勢,所以開始得到更多的應(yīng)用。但這類設(shè)備屬于類鼠標(biāo)設(shè)備,對玩家的真實(shí)射擊體驗(yàn)缺少考慮。一個(gè)好的射擊系統(tǒng),其內(nèi)容涉及到視覺、觸覺、聽覺等多通道感知的有效融合問題。目前的工作很少對此進(jìn)行考慮,從而導(dǎo)致系統(tǒng)普遍缺少很好的用戶體驗(yàn)。為此,本文提出了一種基于MEMS交互槍的交互射擊影院技術(shù)方案,并提出了通過虛實(shí)槍視覺融合方法,為用戶提供更加舒適和更具沉浸感的交互射擊體驗(yàn)。系統(tǒng)基于用戶相對于屏幕的位置和交互槍的指向方向,對虛擬場景進(jìn)行渲染并投影,從而允許用戶在一定范圍內(nèi)隨意移動進(jìn)行射擊游戲,大大提高了用戶的參與感和沉浸感。最后,論文運(yùn)用心流理論,通過主觀調(diào)查問卷的方式和采集用戶生理電數(shù)據(jù)相結(jié)合的方式對用戶的心流狀態(tài)加以更加客觀的剖析。通過對比的方式客觀證明了論文提出的系統(tǒng)更具沉浸感,用戶體驗(yàn)更佳。本文的主要工作與貢獻(xiàn)主要概括如下:1.設(shè)計(jì)制作了基于MEMS的交互槍。交互槍的外形設(shè)計(jì)參考了 QBZ-95突擊步槍,槍身采用ABS塑料1:1比例進(jìn)行3D打印,保留了槍栓設(shè)計(jì),去掉了可拆卸彈夾的設(shè)計(jì),降低了操作復(fù)雜度,使玩家專注于游戲。交互槍的硬件部分包括MPU9150姿態(tài)傳感器芯片、AVR單片機(jī)、用nRF24L01+芯片通信芯片、力反饋驅(qū)動電路和電磁鐵組成。在內(nèi)部的布局上考慮了電磁干擾問題,使得系統(tǒng)可以正常工作。2.提出了一種虛實(shí)槍交互融合方法。基于MEMS傳感器的數(shù)據(jù),結(jié)合Kinect檢測到的人體骨骼節(jié)點(diǎn)數(shù)據(jù),使得射擊交互符合三點(diǎn)一線射擊原理,使得用戶產(chǎn)生虛擬槍與仿真槍重疊的錯(cuò)覺,提高了用戶的交互射擊體驗(yàn)。3.提出了基于用戶生理電數(shù)據(jù)的評估模型。在系統(tǒng)評估測試中,對用戶皮膚電、肌電、心率、呼吸率進(jìn)行采集。結(jié)合主觀評估結(jié)果,對用戶心流狀態(tài)進(jìn)行判定和評估,更加客觀的反應(yīng)了用戶的體驗(yàn),彌補(bǔ)了依靠主觀臆斷的傳統(tǒng)評估方法的不足。
[Abstract]:With the rapid development of virtual reality technology, virtual reality cinemas begin to appear. The popular virtual shooting theater supports many viewers to sit in dynamic seats, wear stereoscopic glasses, and shoot large screen displays with game guns. This kind of shooting cinema can give the audience a very strong immersive experience. Moreover, there is a greater sense of co-existence than the mode of collaborative shooting in VR helmets. Shooting recognition system is the core part of virtual shooting theater. Most of the current shooting recognition systems use interactive methods based on computer vision recognition. This kind of system has many defects, such as not supporting many people, limited interaction scope and so on. In recent years, with the rapid development of sensor technology, there are more and more kinds of sensors, the price is getting cheaper and the precision is getting higher and higher. A number of interactive devices and methods based on MEMS(Micro-Electro-Mechanical system sensors began to emerge, including shooting interactive devices. Compared with the methods based on computer vision, these methods have the advantages of not limited by camera parameters and low cost, so they have been applied more widely. But this kind of device belongs to the class mouse device, lacks consideration to the player's real shooting experience. A good shooting system involves the effective fusion of multi-channel perception such as vision, tactile and auditory. Current work rarely takes this into account, leading to a general lack of good user experience in the system. Therefore, this paper presents a technical scheme of interactive shooting theater based on MEMS interactive gun, and proposes a visual fusion method of virtual gun to provide users with more comfortable and immersive interactive shooting experience. Based on the user's position relative to the screen and the direction of the interactive gun, the system renders and projects the virtual scene, which allows the user to move freely in a certain range for shooting games, which greatly improves the user's sense of participation and immersion. Finally, by using the theory of cardiac flow, the paper makes a more objective analysis of the flow state of users through the combination of subjective questionnaire and the collection of physiological and electrical data of users. It is proved by comparison that the proposed system is more immersive and user experience is better. The main work and contributions of this paper are summarized as follows: 1. The interactive gun based on MEMS is designed and manufactured. The shape design of the interactive gun refers to the QBZ-95 assault rifle. The gun body uses ABS plastic 1:1 scale for 3D printing, retains the design of the bolt, removes the design of the detachable cartridge, reduces the operation complexity, and enables the player to focus on the game. The hardware of the interactive gun consists of a MPU9150 attitude sensor chip, a nRF24L01 chip communication chip, a force feedback drive circuit and an electromagnet. The problem of electromagnetic interference is considered in the internal layout, which makes the system work. 2. 2. An interactive fusion method of virtual gun is proposed. Based on the data of MEMS sensor and the data of human skeleton node detected by Kinect, the shooting interaction accords with the principle of 3.1 line shooting, which makes the user have the illusion that virtual gun and simulated gun overlap, and improves the user's interactive shooting experience. An evaluation model based on user electrophysiological data is proposed. In the system evaluation test, the user's skin electricity, myoelectricity, heart rate and respiration rate were collected. Combined with the subjective evaluation results, the user flow state is judged and evaluated, which reflects the user's experience more objectively and makes up for the shortcomings of the traditional evaluation methods which rely on subjective assumptions.
【學(xué)位授予單位】：山東大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP212;TP391.9

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 陳勤;范樹新;張維波;;MEMS傳感器的標(biāo)準(zhǔn)化現(xiàn)狀與發(fā)展對策[J];傳感器與微系統(tǒng);2007年08期

2 樊建勛;;MEMS傳感器及其在航空領(lǐng)域的應(yīng)用[J];電子技術(shù)與軟件工程;2014年04期

3 殷春燕;;室內(nèi)導(dǎo)航帶來智能手機(jī)新商機(jī),MEMS傳感器加速系統(tǒng)融合[J];集成電路應(yīng)用;2012年08期

4 程海林;黃昌正;郝志峰;張娜;王磊;陳曦;周智恒;;基于彎曲與組合MEMS傳感器的數(shù)據(jù)手套設(shè)計(jì)[J];廣東科技;2013年06期

5 李錚;;MEMS傳感器在車輛運(yùn)動狀態(tài)監(jiān)測系統(tǒng)中的應(yīng)用[J];計(jì)算機(jī)光盤軟件與應(yīng)用;2012年22期

6 桂志鵬;黃德昌;肖湘;謝曉峰;;基于MEMS傳感器的軍民兩用戒指型無線麥克風(fēng)系統(tǒng)的設(shè)計(jì)[J];中國科技信息;2012年07期

7 江興;;2012年MEMS傳感器和執(zhí)行器市場將達(dá)97億美元[J];半導(dǎo)體信息;2008年05期

8 王鐵流;沈京;張強(qiáng)永;王瑛;;基于MEMS傳感器的輸電桿塔傾擺安全監(jiān)測技術(shù)[J];測控技術(shù);2013年05期

9 歐毅;白宏磊;石莎莉;焦斌斌;李超波;黃欽文;董立軍;景玉鵬;陳大鵬;葉甜春;申功;;應(yīng)用于流動控制的MEMS傳感器和執(zhí)行器[J];電子工業(yè)專用設(shè)備;2006年01期

10 許曉青;王寶光;孫春生;;基于MEMS傳感器技術(shù)的微型化、數(shù)字式傾角儀的研究[J];電子測量技術(shù);2008年02期

相關(guān)會議論文 前2條

1 宋渤;徐龍起;張桂銘;趙立波;王曉坡;劉志剛;;MEMS傳感器測量正庚烷密度和黏度的實(shí)驗(yàn)研究[A];高等學(xué)校工程熱物理第十九屆全國學(xué)術(shù)會議論文集[C];2013年

2 杜勇;庹先國;李懷良;朱麗麗;劉勇;;基于MEMS傳感器的數(shù)字高靈敏度VSP測井技術(shù)研究[A];中國地球物理學(xué)會第二十七屆年會論文集[C];2011年

相關(guān)重要報(bào)紙文章 前1條

1 ADI微機(jī)械產(chǎn)品線高級應(yīng)用工程師 趙延輝;MEMS傳感器走向低功耗、集成化[N];中國電子報(bào);2012年

相關(guān)碩士學(xué)位論文 前10條

1 馬瑞濤;基于MEMS傳感器的自適應(yīng)振動監(jiān)測系統(tǒng)的設(shè)計(jì)[D];長安大學(xué);2015年

2 莊猛;MEMS傳感器三維引線鍵合系統(tǒng)研制[D];蘇州大學(xué);2016年

3 仇立杰;基于MEMS傳感器的手勢識別算法研究[D];北京化工大學(xué);2016年

4 劉震;基于MEMS傳感器與Zigbee網(wǎng)絡(luò)的人體手臂運(yùn)動狀態(tài)測量和識別方法研究[D];西南交通大學(xué);2017年

5 譚培培;柔性透明近距離壓力雙功能MEMS傳感器研究[D];北方工業(yè)大學(xué);2017年

6 李豐;壓電式MEMS傳感器的穩(wěn)健設(shè)計(jì)研究[D];北方工業(yè)大學(xué);2017年

7 馮春鵬;多鐵納米MEMS傳感器性能測試系統(tǒng)設(shè)計(jì)[D];北方工業(yè)大學(xué);2017年

8 牛大偉;基于MEMS傳感器的挖掘機(jī)姿態(tài)檢測系統(tǒng)的研究[D];華僑大學(xué);2015年

9 秦溥;基于MEMS傳感器的虛擬現(xiàn)實(shí)射擊識別設(shè)備與系統(tǒng)[D];山東大學(xué);2017年

10 王凱;基于MEMS傳感器的啞鈴動作識別與能耗計(jì)算系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[D];吉林大學(xué);2017年

，

本文編號：1824273