本文選題：人機(jī)交互　切入點(diǎn)：Kinect　出處：《安徽大學(xué)》2017年碩士論文　論文類(lèi)型：學(xué)位論文

【摘要】：隨著計(jì)算機(jī)、信息化的發(fā)展,人機(jī)交互在辦公以及生活中顯得越來(lái)越重要,自然用戶(hù)界面已經(jīng)成為人機(jī)交互發(fā)展的趨勢(shì),目前研究比較熱門(mén)的有用語(yǔ)言、動(dòng)作及表情等與計(jì)算機(jī)進(jìn)行交互。手勢(shì)識(shí)別作為自然人機(jī)交互的一項(xiàng)關(guān)鍵的技術(shù),具有靈活、直觀、簡(jiǎn)單等優(yōu)點(diǎn),成為動(dòng)作與計(jì)算機(jī)交互研究領(lǐng)域中的熱點(diǎn),在業(yè)內(nèi)引起了很多學(xué)者的關(guān)注和研究。手勢(shì)識(shí)別的發(fā)展由早起的佩戴數(shù)據(jù)手套逐漸的轉(zhuǎn)向基于視覺(jué)方法的研究,目前大多的手勢(shì)識(shí)別研究是在計(jì)算機(jī)視覺(jué)的基礎(chǔ)上進(jìn)行的,通過(guò)攝像頭直接獲取背景空間的信息,無(wú)需佩戴復(fù)雜、昂貴的輸入設(shè)備。眾所周知的觸摸屏技術(shù)現(xiàn)已發(fā)展的比較成熟,但大多應(yīng)用于小屏幕的操作上,例如:手機(jī)、筆記本、小型觸摸屏等。針對(duì)大屏幕的操作,目前缺乏較有效的交互手段。本文對(duì)動(dòng)態(tài)手勢(shì)識(shí)別進(jìn)行了研究并設(shè)計(jì)了一套動(dòng)態(tài)手勢(shì)識(shí)別交互系統(tǒng),實(shí)現(xiàn)了人與大屏幕的實(shí)時(shí)互動(dòng)操作。Kinect是微軟2010年研發(fā)出來(lái)的,能夠在復(fù)雜的背景環(huán)境下快速準(zhǔn)確的獲取人體骨骼節(jié)點(diǎn)信息。本文以Kinect為輸入設(shè)備,獲取人體手部、手腕、肘部和脊椎這幾個(gè)關(guān)鍵的骨骼節(jié)點(diǎn)信息作為實(shí)驗(yàn)的特征向量。主要工作有以下幾個(gè)方面:針對(duì)手勢(shì)識(shí)別的研究,分析了整個(gè)識(shí)別過(guò)程,對(duì)識(shí)別過(guò)程中每個(gè)階段采用的技術(shù)做了詳細(xì)的調(diào)查和研究。闡述了 Kinect設(shè)備在獲取深度信息上的強(qiáng)大功能以及基于Kienct手勢(shì)識(shí)別研究的現(xiàn)狀和優(yōu)點(diǎn)。研究了動(dòng)態(tài)手勢(shì)的識(shí)別過(guò)程,針對(duì)手勢(shì)識(shí)別起點(diǎn)和終點(diǎn)的檢測(cè),本文提出一種基于特殊手勢(shì)判斷的方法。定義一種靜態(tài)手勢(shì),通過(guò)識(shí)別定義的手勢(shì)的判斷動(dòng)態(tài)手勢(shì)是否開(kāi)始,對(duì)于動(dòng)態(tài)手勢(shì)的結(jié)束則根據(jù)計(jì)算連續(xù)多幀內(nèi)特征節(jié)點(diǎn)運(yùn)動(dòng)的距離判斷。在動(dòng)態(tài)手勢(shì)識(shí)別過(guò)程中,針對(duì)手勢(shì)識(shí)別的效率和速率問(wèn)題,對(duì)傳統(tǒng)的動(dòng)態(tài)時(shí)間規(guī)整(Dynamic Time Warping,DTW)算法進(jìn)行了改進(jìn)。首先,利用特征節(jié)點(diǎn)在運(yùn)動(dòng)過(guò)程中的方差對(duì)其進(jìn)行了權(quán)值的動(dòng)態(tài)分配,以便提高識(shí)別效率。其次,對(duì)DTW算法的搜索路徑進(jìn)行了詳細(xì)的分析,采取點(diǎn)與線(xiàn)結(jié)合的方法對(duì)其搜索路徑進(jìn)行約束,減少計(jì)算量,提高識(shí)別速率。最后,將改進(jìn)后的DTW算法與K近鄰(K-nearest neighbor,KNN)算法進(jìn)行結(jié)合用于識(shí)別手勢(shì),能夠有效的提高識(shí)別效率。最后,設(shè)計(jì)并實(shí)現(xiàn)了一個(gè)與手勢(shì)識(shí)別相關(guān)的大屏幕互動(dòng)系統(tǒng),在系統(tǒng)中手勢(shì)代替了鼠標(biāo)的部分功能,直接通過(guò)不同的手勢(shì)對(duì)大屏幕上的內(nèi)容進(jìn)行操作,整個(gè)系統(tǒng)運(yùn)行流暢,讓人真實(shí)的體會(huì)到人機(jī)交互。
[Abstract]:With the development of computer and information, human-computer interaction is becoming more and more important in office and daily life. The natural user interface has become the trend of human-computer interaction. Gesture recognition, as a key technology of natural human-computer interaction, has the advantages of flexibility, intuition and simplicity, and has become a hot spot in the field of interaction between action and computer. The development of gesture recognition has gradually shifted from the early wearing of data gloves to the research based on visual methods. At present, most of the research on gesture recognition is carried out on the basis of computer vision. Access to background information directly through the camera without the need to wear complex, expensive input devices. The well-known touch screen technology is now relatively mature, but it is mostly used in small screen operations, such as mobile phones, laptops, etc. Small touch screen and so on. For the operation of large screen, there is a lack of effective interactive means. In this paper, dynamic gesture recognition is studied and a set of dynamic gesture recognition interaction system is designed. The real-time interactive operation of human and large screen. Kinect is developed by Microsoft in 2010. It can quickly and accurately obtain human skeleton node information in complex background environment. In this paper, Kinect is used as input device to obtain human hands and wrists. Elbows and vertebrae are the key information of bone nodes as the feature vectors of the experiment. The main work includes the following aspects: according to the research of gesture recognition, the whole recognition process is analyzed. This paper makes a detailed investigation and research on the technology used in each stage of the recognition process, expounds the powerful function of Kinect equipment in obtaining depth information and the present situation and advantages of the research on gesture recognition based on Kienct, and studies the process of dynamic gesture recognition. Aiming at the detection of the beginning and end of gesture recognition, this paper proposes a method based on special gesture judgment, which defines a static gesture and determines whether the dynamic gesture begins or not by recognizing the defined gesture. For the end of dynamic gesture, the distance of motion of feature nodes in successive frames is calculated. In the process of dynamic gesture recognition, the efficiency and rate of gesture recognition are discussed. The traditional dynamic Time warping (DTW) algorithm is improved. Firstly, the weights are dynamically assigned by the variance of feature nodes in the process of motion in order to improve the recognition efficiency. The search path of DTW algorithm is analyzed in detail, and the search path is constrained by the combination of point and line, which can reduce the amount of calculation and improve the recognition rate. The improved DTW algorithm and K-nearest neighbor KNN algorithm are combined to recognize gestures, which can effectively improve the recognition efficiency. Finally, a large screen interactive system related to gesture recognition is designed and implemented. In the system hand gestures replace some of the functions of the mouse directly through different gestures on the large screen content to operate the whole system runs smoothly let people truly understand the human-computer interaction.
【學(xué)位授予單位】：安徽大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類(lèi)號(hào)】：TP391.41

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 郭迪;孫富春;劉華平;黃文炳;;基于Kinect的冗余機(jī)械臂直線(xiàn)推移操作控制[J];東南大學(xué)學(xué)報(bào)(自然科學(xué)版);2013年S1期

2 韓崢;劉華平;黃文炳;孫富春;高蒙;;基于Kinect的機(jī)械臂目標(biāo)抓取[J];智能系統(tǒng)學(xué)報(bào);2013年02期

3 楊東方;王仕成;劉華平;劉志國(guó);孫富春;;基于Kinect系統(tǒng)的場(chǎng)景建模與機(jī)器人自主導(dǎo)航[J];機(jī)器人;2012年05期

4 ;三大家用游戲機(jī)殊死戰(zhàn) Kinect推動(dòng)Xbox 360迎向2011年龍頭地位[J];電子與電腦;2011年02期

5 ;微軟Kinect的機(jī)會(huì)[J];IT時(shí)代周刊;2011年Z1期

6 金燁;;Kinect:微軟新生?[J];中國(guó)經(jīng)濟(jì)和信息化;2011年07期

7 ;微軟新版Kinect可讀唇語(yǔ)[J];計(jì)算機(jī)與網(wǎng)絡(luò);2012年Z1期

8 黃露丹;嚴(yán)利民;;基于Kinect深度數(shù)據(jù)的人物檢測(cè)[J];計(jì)算機(jī)技術(shù)與發(fā)展;2013年04期

9 羅東;;Kinect,看手勢(shì)![J];21世紀(jì)商業(yè)評(píng)論;2013年24期

10 黃浩;李坤;;基于Kinect的虛擬視點(diǎn)生成技術(shù)[J];信息技術(shù);2014年04期

相關(guān)會(huì)議論文 前1條

1 郭迪;孫富春;劉華平;黃文炳;;基于Kinect的冗余機(jī)械臂直線(xiàn)推移操作控制[A];2013年中國(guó)智能自動(dòng)化學(xué)術(shù)會(huì)議論文集（第三分冊(cè)）[C];2013年

相關(guān)碩士學(xué)位論文 前10條

1 李鵬飛;基于Kinect的體感識(shí)別技術(shù)及其在旗語(yǔ)培訓(xùn)中的應(yīng)用[D];西南交通大學(xué);2015年

2 李昕迪;基于Kinect的人體姿勢(shì)識(shí)別方法在舞蹈訓(xùn)練中的應(yīng)用[D];黑龍江大學(xué);2015年

3 陳福財(cái);基于Kinect的連續(xù)中國(guó)手語(yǔ)識(shí)別[D];山東大學(xué);2016年

4 呂巖;微型四軸飛行器設(shè)計(jì)及基于Kinect手勢(shì)控制的實(shí)現(xiàn)[D];鄭州大學(xué);2016年

5 陳嘉衍;基于Kinect的動(dòng)態(tài)虛擬聽(tīng)覺(jué)重放[D];華南理工大學(xué);2016年

6 葉平;基于Kinect的實(shí)時(shí)手語(yǔ)識(shí)別技術(shù)研究[D];南京航空航天大學(xué);2016年

7 任洪林;基于Kinect的個(gè)性化人體三維動(dòng)作重現(xiàn)與動(dòng)作細(xì)節(jié)比對(duì)研究[D];天津大學(xué);2014年

8 陳策;基于Kinect深度視覺(jué)的服務(wù)機(jī)器人自定位研究[D];沈陽(yáng)建筑大學(xué);2016年

9 劉偉康;基于Kinect的靜態(tài)數(shù)字手語(yǔ)識(shí)別研究及系統(tǒng)實(shí)現(xiàn)[D];河南大學(xué);2016年

10 劉亞楠;基于Kinect的電梯客流統(tǒng)計(jì)方法研究[D];沈陽(yáng)建筑大學(xué);2014年

，

本文編號(hào)：1589184