基于視差估計與校正的虛擬視點繪制技術(shù)研究
本文選題:視差估計 + 校正; 參考:《福州大學(xué)》2014年碩士論文
【摘要】:隨著三維顯示技術(shù)的發(fā)展,三維電視系統(tǒng)(3DTV)也逐步的完善,即將向下個目標(biāo)自由立體顯示邁進(jìn)。在自由立體顯示系統(tǒng)中,用戶能自由的切換場景中的視角,擁有更好的用戶體驗。然而,我們不可能使用無限多個攝像機(jī)進(jìn)行場景的采集,因此,目前主要采用虛擬視點繪制技術(shù),通過場景中有限的視角,產(chǎn)生出其他視角的影像。但是,虛擬視點的繪制技術(shù)還存在著不少問題需要解決。因此,一種高效合理的虛擬視點繪制技術(shù)是目前三維立體顯示中研究的熱點。本文主要是針對目前虛擬視點繪制中DIBR技術(shù)出現(xiàn)的問題進(jìn)行改進(jìn),包括深度圖獲取過程中,在場景不連續(xù)和低紋理區(qū)域中產(chǎn)生的誤差,以及在虛擬視點繪制中空洞填補出現(xiàn)的重影和不協(xié)調(diào)等現(xiàn)象進(jìn)行處理。論文研究的主要內(nèi)容包括以下部分:首先研究了區(qū)域立體匹配算法中,場景不連續(xù)區(qū)域和低紋理區(qū)域出現(xiàn)的誤匹配問題,提出一種可變窗口的視差估計方法,該方法是利用較大的窗口先進(jìn)行區(qū)域匹配,選擇可靠性較高的匹配點,之后采用mean-shift圖像分割算法將圖像分割,利用分割后的圖像平滑約束條件,將可靠的匹配點擴(kuò)散到整個區(qū)域,從而,提高整體的視差估計精度,算法相比傳統(tǒng)的自適應(yīng)匹配算法,視差不連續(xù)區(qū)域匹配誤差降低10%左右。其次,將立體匹配得到的視差圖轉(zhuǎn)換成深度圖,進(jìn)行基于深度圖的虛擬視點繪制,針對雙向虛擬繪制技術(shù)中的空洞填補,由深度圖不精確造成的誤差,提出一種深度誤差校正的空洞填補技術(shù),首先,分別對左右參考圖像進(jìn)行三維映射,提取參考圖像空洞的鄰域與目標(biāo)圖像進(jìn)行SAD匹配,計算匹配代價最小的偏移值。然后將目標(biāo)圖像按照獲取的偏移量進(jìn)行調(diào)整,從而,對深度圖產(chǎn)生的誤差進(jìn)行校正,提高空洞填補的精度。最后,針對雙向虛擬視點繪制中出現(xiàn)的偽影和場景不協(xié)調(diào)現(xiàn)象,采用一種線性融合技術(shù),將空洞的鄰域進(jìn)行線性融合。在目標(biāo)圖像經(jīng)過SAD校正后,根據(jù)鄰域像素的可靠性,由參考圖和目標(biāo)圖按照一定的比例進(jìn)行融合,因此,該方法不會出現(xiàn)重影現(xiàn)象,而且可以減輕場景的偽影和不協(xié)調(diào)等現(xiàn)象。相比傳統(tǒng)的雙向DIBR算法,本文算法的PSNR值提升0.77dB左右。虛擬視點繪制技術(shù)作為自由立體顯示系統(tǒng)中關(guān)鍵部分。本文針對傳統(tǒng)的DIBR算法存在的問題,進(jìn)行分析和改善。在主觀視覺觀看效果和客觀評價上都有一定的提升。
[Abstract]:With the development of 3D display technology, 3D TV system (3DTV) is gradually improved, and the next target is Auto-stereoscopic display. In the stereoscopic display system, the user can freely switch the perspective of the scene and have a better user experience. However, it is impossible for us to use infinite cameras to capture the scene. Therefore, at present, we mainly use virtual view rendering technology to produce images of other visual angles through the limited visual angle in the scene. However, there are still many problems to be solved in virtual view rendering technology. Therefore, an efficient and reasonable virtual view rendering technology is a hot topic in 3D stereo display. This paper mainly aims at improving the problems of DIBR technology in virtual view rendering, including the errors in scene discontinuity and low texture region in depth map acquisition. And in the virtual point of view rendering holes filled in the appearance of double-shadow and disharmony and other phenomena to deal with. The main contents of this paper are as follows: firstly, the mismatch problem in the discontinuous region and low texture region in the region stereo matching algorithm is studied, and a variable window disparity estimation method is proposed. The method uses large window to match the region first, selects the matching point with high reliability, then uses mean-shift image segmentation algorithm to segment the image, and uses the constraint condition of image smoothing after segmentation. The reliable matching points are spread to the whole region, so that the overall disparity estimation accuracy is improved. Compared with the traditional adaptive matching algorithm, the disparity discontinuous region matching error is reduced by about 10%. Secondly, the parallax map obtained by stereo matching is converted into depth map, and the virtual viewpoint drawing based on depth map is carried out. The errors caused by the inaccuracy of depth map are filled in the void of bidirectional virtual rendering technology. A hole filling technique for depth error correction is proposed. Firstly, 3D mapping of left and right reference images is carried out, and the neighborhood of the reference image is extracted for SAD matching with the target image, and the offsets with the least matching cost are calculated. Then the target image is adjusted according to the obtained offset, and the error caused by the depth map is corrected to improve the accuracy of cavity filling. Finally, aiming at the artifacts and scene disharmony in bidirectional virtual view rendering, a linear fusion technique is used to fuse the empty neighborhood. After the target image is corrected by SAD, according to the reliability of the neighborhood pixels, the reference map and the target map are fused according to a certain proportion. Therefore, the method does not appear the phenomenon of double shadow, and can reduce the phenomenon of artifact and incongruity of the scene. Compared with the traditional bidirectional DIBR algorithm, the PSNR value of this algorithm is increased by about 0.77dB. Virtual view rendering technology is a key part of the autostereoscopic display system. This paper analyzes and improves the problems existing in the traditional DIBR algorithm. In subjective visual viewing effect and objective evaluation have a certain improvement.
【學(xué)位授予單位】:福州大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2014
【分類號】:TN873
【相似文獻(xiàn)】
相關(guān)期刊論文 前10條
1 黃銅城;基于圖象的虛擬場景繪制技術(shù)[J];邵陽師范高等專科學(xué)校學(xué)報;2001年05期
2 錢徽,朱淼良;大氣效果的繪制技術(shù)綜述[J];計算機(jī)輔助設(shè)計與圖形學(xué)學(xué)報;2002年05期
3 張武;黃爭舸;張楨夏;;點繪制技術(shù)的研究[J];計算機(jī)工程;2007年05期
4 王秀友;;基于點的造型和繪制技術(shù)[J];科技廣場;2007年07期
5 周東翔,蔡宣平,孫茂印;基于圖象的繪制技術(shù)[J];計算機(jī)工程與科學(xué);1999年04期
6 劉興;曹衛(wèi)群;;大規(guī)模植物場景繪制技術(shù)綜述[J];農(nóng)業(yè)網(wǎng)絡(luò)信息;2010年04期
7 El_NION;;圣環(huán):時代的命運[J];軟件;2004年06期
8 孫學(xué)波;張小蘇;;真實感樹木繪制技術(shù)研究[J];計算機(jī)工程與設(shè)計;2008年08期
9 郭曉永;陳克林;;基于圖像的鉛筆畫繪制技術(shù)[J];重慶工商大學(xué)學(xué)報(自然科學(xué)版);2009年03期
10 宋文敏;劉偉;;基于圖像的繪制技術(shù)綜述[J];電腦知識與技術(shù);2009年05期
相關(guān)會議論文 前5條
1 唐勇;陶力;;實時陰影繪制技術(shù)的研究與應(yīng)用[A];立體圖象技術(shù)及其應(yīng)用研討會論文集[C];2005年
2 崔雪峰;王林旭;王玨;;大規(guī)模復(fù)雜場景的交互繪制技術(shù)[A];全國第19屆計算機(jī)技術(shù)與應(yīng)用(CACIS)學(xué)術(shù)會議論文集(上冊)[C];2008年
3 任利鋒;張明敏;潘志庚;;虛擬場景的限時繪制技術(shù)[A];第十二屆全國圖象圖形學(xué)學(xué)術(shù)會議論文集[C];2005年
4 董晶晶;;基于圖像繪制技術(shù)的虛擬場景構(gòu)建及漫游技術(shù)研究[A];2007系統(tǒng)仿真技術(shù)及其應(yīng)用學(xué)術(shù)會議論文集[C];2007年
5 衡曉周;任鴻翔;金一丞;;雕塑類復(fù)雜景物建模與繪制技術(shù)的研究[A];第十四屆全國圖象圖形學(xué)學(xué)術(shù)會議論文集[C];2008年
相關(guān)博士學(xué)位論文 前6條
1 吳e,
本文編號:1939118
本文鏈接:http://sikaile.net/kejilunwen/wltx/1939118.html