本文選題：增強(qiáng)現(xiàn)實(shí) + Kinect��； 參考：《南京信息工程大學(xué)》2016年碩士論文

【摘要】：增強(qiáng)現(xiàn)實(shí)(Augmented Reality,簡(jiǎn)稱AR),是在虛擬現(xiàn)實(shí)基礎(chǔ)上發(fā)展起來的新技術(shù)。它是將計(jì)算機(jī)生成的虛擬物體、場(chǎng)景或提示信息疊加到真實(shí)場(chǎng)景中,從而實(shí)現(xiàn)對(duì)現(xiàn)實(shí)的增強(qiáng)。近年來,增強(qiáng)現(xiàn)實(shí)技術(shù)在康復(fù)訓(xùn)練中逐漸得到應(yīng)用。將AR技術(shù)應(yīng)用于手部康復(fù),除了具有虛擬現(xiàn)實(shí)(Virtual Reality,VR)康復(fù)技術(shù)的優(yōu)點(diǎn)之外,更具感知優(yōu)勢(shì)。身處其中的用戶并未與周圍的真實(shí)環(huán)境相隔離,他們能夠在場(chǎng)景中看到自己真實(shí)的手,并以更加自然的方式與真實(shí)場(chǎng)景及虛擬物體進(jìn)行實(shí)時(shí)交互,提高了交互的真實(shí)性與實(shí)用性。本文以國(guó)家自然科學(xué)基金項(xiàng)目為背景,將EMD算法引入并指等復(fù)雜手勢(shì)識(shí)別,并開發(fā)了一個(gè)基于Kinect的增強(qiáng)實(shí)現(xiàn)手部康復(fù)自然交互系統(tǒng)。本文主要研究?jī)?nèi)容包括以下幾個(gè)方面：首先本文通過利用Kinect設(shè)備,在靜態(tài)識(shí)別下,針對(duì)手部康復(fù)過程中手指粘連或并攏等復(fù)雜問題提出了EMD算法準(zhǔn)確地識(shí)別手勢(shì),并用這種算法和傳統(tǒng)的基于模塊、向量機(jī)等識(shí)別算法進(jìn)行比較,詳細(xì)分析了各種算法的優(yōu)缺點(diǎn),證明基于EMD手勢(shì)識(shí)別算法的優(yōu)越性。針對(duì)動(dòng)態(tài)手勢(shì)的增強(qiáng)現(xiàn)實(shí),本文基于Openframeworks框架建立了增強(qiáng)現(xiàn)實(shí)交互環(huán)境。其中增強(qiáng)現(xiàn)實(shí)交互為二維交互和三維交互,基于二維的交互主要將虛擬物體直接根據(jù)二維坐標(biāo)疊加到場(chǎng)景中,進(jìn)行交互。而基于三維的交互先獲得內(nèi)外參數(shù),然后得到創(chuàng)建的三維坐標(biāo)系,最后將三維模型載入,實(shí)現(xiàn)互動(dòng)。本文在相關(guān)醫(yī)生的指導(dǎo)下,依照手部作業(yè)治療的康復(fù)訓(xùn)練方法設(shè)計(jì)了抓握捏訓(xùn)練、軌跡訓(xùn)練、單手交互訓(xùn)練和雙手交互訓(xùn)練項(xiàng)目,這些訓(xùn)練項(xiàng)目在難度等級(jí)上存在遞進(jìn)關(guān)系,最后通過實(shí)驗(yàn)對(duì)參數(shù)值指標(biāo)進(jìn)行問卷評(píng)估和分析,驗(yàn)證了本系統(tǒng)的有效性和可行性。
[Abstract]:Augmented reality is a new technology developed on the basis of virtual reality. It overlay the computer generated virtual object, scene or prompt information into the real scene, so as to realize the enhancement of reality. In recent years, augmented reality technology has been gradually applied in rehabilitation training. The application of AR technology in hand rehabilitation has the advantages of virtual reality (VR) and virtual reality (VRV). Instead of being isolated from the real environment, the users are able to see their real hands in the scene and interact in real time with the real scene and virtual objects in a more natural way. It improves the authenticity and practicability of interaction. Based on the project of National Natural Science Foundation of China, this paper introduces EMD algorithm into hand recognition and develops an enhanced hand rehabilitation natural interaction system based on Kinect. The main contents of this paper include the following aspects: firstly, by using Kinect equipment and static recognition, an EMD algorithm is proposed to recognize hand gestures accurately, aiming at the complex problems of finger adhesion or convergence during hand rehabilitation. Compared with traditional algorithms based on module and vector machine, the advantages and disadvantages of these algorithms are analyzed in detail, and the superiority of gesture recognition algorithm based on EMD is proved. Aiming at the augmented reality of dynamic gesture, this paper establishes an augmented reality interactive environment based on Openframeworks framework. The augmented reality interaction consists of two dimensional interaction and three dimensional interaction. The interaction based on two dimensions mainly superposes the virtual object into the scene directly according to the two dimensional coordinates. The internal and external parameters are obtained based on the 3D interaction, and then the 3D coordinate system is created. Finally, the 3D model is loaded to realize the interaction. Under the guidance of relevant doctors, according to the rehabilitation training method of hand work therapy, this paper designs grip training, track training, one-hand interactive training and two-hand interactive training. These training items have a progressive relationship in the level of difficulty. Finally, the validity and feasibility of the system are verified by the questionnaire evaluation and analysis of the parameter index.
【學(xué)位授予單位】：南京信息工程大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2016
【分類號(hào)】：R49;TP391.9
，

本文編號(hào)：2022115