發(fā)布時間：2019-02-20 07:30

【摘要】：自由視點電視是三維立體電視的一個分支,是未來電視發(fā)展的方向。相比傳統(tǒng)的3D電視,自由視點電視能夠帶給人們更好的立體體驗。虛擬視點合成技術(shù)是自由視點電視的核心技術(shù),其中最受關(guān)注的是基于深度圖的繪制技術(shù)(Depth Image Based Rendering,DIBR)。利用DIBR技術(shù)可以快速生成虛擬視點圖像,但是僅僅依靠DfIBR技術(shù)合成的圖像并不理想,往往包含一些“偽影”和大小不等的空洞。而且,現(xiàn)有的基于DIBR技術(shù)的虛擬視點合成算法一般比較耗時,很難做到虛擬視點的實時合成。本文主要的研究內(nèi)容是:分析以上問題產(chǎn)生的原因,并有針對性的提出相應(yīng)的解決方案。(1)“偽影”往往出現(xiàn)在前景和背景相交的地方,主要由深度的不連續(xù)性和多個相機拍攝到的場景的顏色差異造成。針對“偽影”問題,本文對參考視點圖像進(jìn)行色彩校正,并綜合基于深度的彩色圖融合和彩色圖直接融合兩種方式融合圖像,來減弱“偽影”現(xiàn)象。(2)空洞問題是虛擬視點合成中最重要,也最難解決的問題,主要是由視點變換中物體間遮擋關(guān)系發(fā)生變化造成的。針對較小的空洞,本文主要采用深度圖預(yù)處理和反向映射方法;針對較大的空洞,本文采用了基于輔助深度信息的圖像修復(fù)算法,但是該算法運行比較耗時。為了加快空洞填補速度,本文將基于輔助深度信息圖像修復(fù)算法并行化,通過 NVIDIA 公司推出的 CUDA(Compute Unified Device Architecture)并行編程框架,利用GPU來加速該算法,可以大大減少空洞填補時間。實驗結(jié)果表明,本文針對“偽影”問題的處理及基于輔助深度信息的圖像修復(fù)的空.洞填補算法可以有效地提高虛擬視點圖像合成質(zhì)量,同時基于CUDA實現(xiàn)的并行空洞填補算法也大幅降低了空洞填補時間。
[Abstract]:Free-view TV is a branch of three-dimensional TV and the direction of TV development in the future. Compared with traditional 3D TV, free view TV can bring people a better stereoscopic experience. Virtual view synthesis technology is the core technology of free view television, and the most concerned technology is depth map based rendering technology (Depth Image Based Rendering,DIBR). The virtual view image can be generated quickly by using DIBR technology, but the image synthesized only by DfIBR technology is not ideal, and often contains some "artifacts" and holes of different sizes. Moreover, the existing virtual viewpoint synthesis algorithms based on DIBR technology are usually time-consuming, and it is difficult to achieve real-time virtual view synthesis. The main research contents of this paper are as follows: analyzing the causes of the above problems and putting forward corresponding solutions. (1) "artifact" often appears in the place where the foreground and background intersect. It is mainly caused by the discontinuity of depth and the color difference of the scene captured by multiple cameras. Aiming at the problem of "artifact", the color correction of reference view image is carried out in this paper, and the color image fusion based on depth and the color image fusion directly are integrated. (2) void problem is the most important and most difficult problem in virtual view synthesis, which is mainly caused by the change of occlusion relationship between objects in view transformation. For the smaller voids, this paper mainly uses depth map preprocessing and reverse mapping methods, for the larger holes, this paper uses an image restoration algorithm based on auxiliary depth information, but the algorithm runs more time-consuming. In order to speed up the filling speed of holes, this paper parallelizes the image restoration algorithm based on auxiliary depth information. Through the parallel programming framework of CUDA (Compute Unified Device Architecture) developed by NVIDIA Company, using GPU to accelerate the algorithm, the time of filling holes can be greatly reduced. The experimental results show that the processing of "artifact" and the space of image restoration based on auxiliary depth information are discussed in this paper. The hole filling algorithm can effectively improve the quality of virtual view image synthesis, and the parallel hole filling algorithm based on CUDA also reduces the void filling time significantly.
【學(xué)位授予單位】：東南大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2016
【分類號】：TP391.41

【參考文獻(xiàn)】

相關(guān)期刊論文 前2條

1 郁理;郭立;袁紅星;;基于深度圖像的視點繪制新方法[J];中國科學(xué)院研究生院學(xué)報;2010年05期

2 張紅英;彭啟琮;;數(shù)字圖像修復(fù)技術(shù)綜述[J];中國圖象圖形學(xué)報;2007年01期

相關(guān)博士學(xué)位論文 前1條

1 邵楓;自由視點視頻信號處理中的關(guān)鍵技術(shù)研究[D];浙江大學(xué);2007年

相關(guān)碩士學(xué)位論文 前3條

1 王震;自由視點立體電視系統(tǒng)的虛擬視點合成技術(shù)研究[D];上海交通大學(xué);2012年

2 劉華杰;3D視頻編碼算法研究[D];大連理工大學(xué);2010年

3 馮雅美;自然三維電視系統(tǒng)中虛擬視點繪制技術(shù)研究[D];浙江大學(xué);2010年

，

本文編號：2426943