本文選題：虛擬現(xiàn)實 + 增強虛擬　； 參考：《武漢大學》2014年博士論文

【摘要】：視頻監(jiān)控系統(tǒng)是當今安全防范系統(tǒng)的重要組成部分,廣泛地應用于人們的日常生活,而虛擬三維系統(tǒng)是計算機科學及其相關學科領域發(fā)展的重要成果,它的應用也非常廣泛。將視頻影像融入到虛擬三維系統(tǒng)中以增強虛擬三維場景的真實感,一方面既能夠發(fā)揮視頻影像來源廣泛、信息獲取方式靈活和實時傳輸方便的優(yōu)點,另一方面又能夠給虛擬三維系統(tǒng)增加時間維度,將實時、動態(tài)的客觀世界信息展現(xiàn)在靜態(tài)的虛擬三維場景中。同時,視頻信息融入到虛擬三維場景中還能夠克服視頻影像分散、無組織的缺點以及虛擬三維場景無動態(tài)信息的局限性,從而形成優(yōu)勢互補,從整體上提高二者的應用價值。本文主要是針對當前視頻影像增強虛擬三維場景過程中的注冊與渲染這兩個核心問題展開了相關的研究工作,主要研究內容、研究方法和成果如下： (1)分別分析了視頻影像增強虛擬三維場景過程中的注冊和渲染這兩個核心問題的方法原理：基于視頻影像成像模型與虛擬三維場景成像模型的一致性,構建了視頻相機內外方位元素與三維渲染引擎相關函數(shù)之間的對應關系,可以將后續(xù)計算獲得的內外方位元素轉換為三維渲染函數(shù)的相關參數(shù),從而將視頻影像準確地注冊到虛擬三維場景中；研究分析了視頻影像三維渲染的一般性和特殊性,并基于DirectShow流媒體技術設計了視頻影像過濾器,能夠從不同來源的視頻數(shù)據中獲取實時的紋理圖片,并可以利用GPU加速渲染的方法來提高系統(tǒng)的整體效率。 (2)在研究分析視頻監(jiān)控場景的控制條件和先驗知識的基礎上,探索了視頻影像對虛擬三維場景進行注冊的方法路線,確定了視頻影像內外方位元素分步求解的方法途徑,主要包括利用成本較低、操作方便的一維標定法和綜合多種特征的后方交會法分別求解視頻影像的內外方位元素。 (3)深入地分析了相機一維標定法的誤差來源,并在此基礎上提出了一種改進的單像一維標定法和一種基于像對基礎矩陣的多像一維標定法,這兩種方法均能夠獲得較高精度的標定結果,能夠在一定程度上克服一維標定物構造簡易、幾何約束較差的局限性,適用于視頻監(jiān)控場景中的相機內標定。 (4)基于廣義點攝影測量理論提出了一種綜合多種特征的后方交會法,該方法能夠將水平線、垂直線、線段和水平圓做為控制條件聯(lián)合常規(guī)的控制點構建統(tǒng)一的平差模型從而求解相機的外方位元素,能夠在一定程度上擺脫傳統(tǒng)后方交會法對控制點的強烈依賴,使基于共線方程的后方交會法具有更廣的適用范圍,適用于先驗知識缺乏、控制點難以布設的視頻監(jiān)控場景。 (5)針對視頻影像在虛擬三維場景中渲染所涉及到的數(shù)據量與實時性這兩個瓶頸問題,著重研究視頻影像合理的組織、訪問與調度方法來提高視頻影像的渲染效率,主要包括：基于多線程技術提出了一種視頻數(shù)據讀取的任務分配和消息通信方法,能夠解決虛擬三維系統(tǒng)用戶操作與視頻數(shù)據讀取之間的響應沖突；根據近大遠小的原則,提出了一種視頻影像實時分辨率的計算方法；基于四叉樹原理設計了一種視頻影像的空間索引；最后,綜合上述方法和技術,設計了一種視頻數(shù)據的緩沖與調度機制,以實現(xiàn)視頻影像在虛擬三維場景中的高效渲染。另外,還針對視頻相機視角與虛擬三維場景視角不一致的問題,變相地使用了ShadowMap算法來檢測其可見性。 通過上述工作,本文在很大程度上解決了視頻影像在虛擬三維場景中的注冊和渲染這兩個核心問題,對視頻影像融入虛擬三維系統(tǒng)的實際應用有較大的幫助,對增強虛擬技術和視頻GIS的發(fā)展有一定的貢獻價值,對相機標定和視頻紋理的相關研究有一定的借鑒意義。
[Abstract]:The video monitoring system is an important part of the security system, widely used in people's daily life, and the virtual 3D system is an important achievement in the development of computer science and related disciplines, its application is very extensive. The video image into a virtual three-dimensional system to enhance the reality of virtual 3D scene. On the one hand can play video sources, flexible information acquisition and real-time transmission convenient, on the other hand can also increase the time dimension, to the virtual 3D system real-time, dynamic and objective world of information displayed in the virtual 3D scene static. At the same time, the video information into the virtual three-dimensional scene can also to overcome the limitations of the video image dispersion, dynamic information organization and disadvantages of virtual 3D scene, so as to form complementary advantages, enhance the overall two The application value of this paper is mainly related to the two core issues of video and image enhancement in the process of virtual 3D scene registration and rendering. The main research contents and methods are as follows:
(1) analyzed video image enhancement principle and method of the two core issues of virtual 3D scene in the process of registration and rendering: consistency of video imaging models and 3D virtual scene imaging model based on the construction of the corresponding relation between the correlation function of video camera interior orientation element and 3D rendering engine, and can be the orientation elements obtained subsequent conversion related parameters for 3D rendering functions, which will be registered to the video image accurately in virtual three-dimensional scene; analysis of the universality and particularity of the video image rendering, and video image filter is designed based on DirectShow streaming media technology, can obtain real-time texture images from video data the source, and can accelerate the rendering method to improve the overall efficiency of the system by using GPU.
(2) in the study of video scenes control conditions and on the basis of prior knowledge of video image registration method on line virtual 3D scene, method of video image and external orientation elements step solution were determined, including the use of low cost, internal and external orientation elements resection method convenient one-dimensional calibration method and comprehensive features of the video images are solved.
(3) the in-depth analysis of the error sources of the camera calibration method is one-dimensional, and put forward an improved single image based on a one-dimensional calibration method and the like on the basis of matrix like one-dimensional calibration method, the two methods can obtain the calibration result with high accuracy, can be overcome to a certain extent one dimensional calibration of simple structure and limitation of the geometric constraint. The scene for video surveillance in camera calibration.
(4) the theory of the generalized point photogrammetry presents a comprehensive resection method based on multi features, this method can be a horizontal line, vertical line, line and circle do to build a unified control point control conditions combined with conventional adjustment model to solve the exterior orientation elements of the camera, can get rid of the traditional method of resection a strong dependence on the control point to a certain extent, the resection method based on the collinear equation has wider application range, applicable to the lack of knowledge of video surveillance, scene control point is difficult to layout.
(5) the two bottleneck data for video image in virtual 3D scene rendering involved with real-time video images, focuses on the reasonable organization, access and scheduling method to improve the video image rendering efficiency, mainly including: multi thread technology presents a video data reading and task allocation message communication method based on virtual 3D system can solve the conflict in response to user operation and read video data between; according to near the small principle, this paper proposes a calculation method of real-time video image resolution; four tree spatial index based on the principle of the design of a video image; finally, the above methods and techniques, design the buffering and scheduling mechanism for video data, in order to achieve efficient rendering of video images in a virtual three-dimensional scene. In addition, the video camera and the virtual three The ShadowMap algorithm is used to detect the visibility of the dimensional scene.
Through the above work, this paper solves the two key problems in virtual 3D scene in the video image registration and rendering to a great extent, the actual application of the video image into the virtual 3D system are of great help, there is a certain contribution to enhance the development of virtual technology and video GIS, have certain reference significance research on camera calibration and video texture.

【學位授予單位】：武漢大學
【學位級別】：博士
【學位授予年份】：2014
【分類號】：TP391.41;TN948.6

【參考文獻】

相關期刊論文 前10條

1 王濤;呂乃光;楊劍;;基于一維標定物的高精度標定[J];北京信息科技大學學報(自然科學版);2010年01期

2 官云蘭;周世健;周銘;賈永華;;基于角錐體原理的空間后方交會改進算法[J];測繪科學;2006年02期

3 宋宏權;孔云峰;;Flex框架下網絡視頻GIS設計與實現(xiàn)[J];測繪科學;2010年05期

4 豐江帆;張宏;沙月進;;GPS車載移動視頻監(jiān)控系統(tǒng)的設計[J];測繪通報;2007年02期

5 吳勇;劉學軍;趙華;吳游;;可定位視頻采集方法研究[J];測繪通報;2010年01期

6 黃丙湖;韓李濤;孫根云;陳龍;;三維GIS與視頻監(jiān)控系統(tǒng)的集成與應用研究[J];測繪通報;2011年01期

7 江剛武;姜挺;王勇;龔輝;;基于單位四元數(shù)的無初值依賴空間后方交會[J];測繪學報;2007年02期

8 官云蘭;程效軍;周世健;廖中平;魯鐵定;;基于單位四元數(shù)的空間后方交會解算[J];測繪學報;2008年01期

9 鄭順義;郭寶云;李彩林;;基于模型和廣義點攝影測量的圓柱體自動三維重建與檢測[J];測繪學報;2011年04期

10 孔云峰;;地理視頻數(shù)據模型及其應用開發(fā)研究[J];地理與地理信息科學;2009年05期

，

本文編號：1748852