本文選題：可分級 + 多視點��； 參考：《武漢大學(xué)》2014年博士論文

【摘要】：隨著計算機硬件和立體顯示技術(shù)的迅速發(fā)展,多視點立體視頻逐漸進入我們的生活。多視點立體視頻包括不同視點視頻的整合應(yīng)用,使用者能除了能感受到立體的場景之外,它也提供收視者與播放系統(tǒng)間的互動性。多視點立體視頻系統(tǒng)不同于以往的視頻特性,為了使收視者能感覺到畫面深度的變化,通過相關(guān)的播放系統(tǒng),能夠?qū)⑴臄z的場景從各種角度完整忠實呈現(xiàn)給收視者。利用多視點立體視頻多視角以及立體影像重現(xiàn)的特性,收視者能夠體驗到不同于以往的視覺效果。 相對于傳統(tǒng)視頻而言,多視點立體視頻的數(shù)據(jù)更為龐大,且各視點間存在極大的相似性,因此開發(fā)高效率的多視點立體視頻壓縮技術(shù)便顯得格外重要。為了達到任意視點的立體視頻交互響應(yīng),各視點視頻資料以及交互式呈現(xiàn)系統(tǒng)所需的視差信息以及切換信息都是不可或缺的,如何有效的壓縮這些信息將是未來多視點立體視頻壓縮技術(shù)的研究重點。 在研究多視點立體視頻編碼的同時,客戶端硬件環(huán)境和網(wǎng)絡(luò)環(huán)境也需要同時考慮。尤其近來隨著手機運算能力的提高,透過手機觀賞數(shù)字電視已不再是夢想,移動影音服務(wù)的質(zhì)量逐漸成為備受重視的新領(lǐng)域。但因為網(wǎng)絡(luò)環(huán)境及封包傳輸行為的不同,必須依據(jù)其特性分別加以處理,如何能夠隨著現(xiàn)有帶寬狀況快速調(diào)整多視點視頻當前碼率,以增進系統(tǒng)效能與影音服務(wù)質(zhì)量便成為重要的課題。 本文根據(jù)多視點立體視頻的特點,通過多視點立體視頻其視點間高度相關(guān)性,研究了如何快速提取多視點立體視頻的深度圖,并且優(yōu)化視點間互相參考編碼的參考架構(gòu),降低視點間的冗余計算,提高多視點視頻的編碼效率。然后提出了可分級多視點立體視頻編碼的并行架構(gòu),最后對該編碼方案在網(wǎng)絡(luò)上的傳輸策略進行了研究,使視頻數(shù)據(jù)流具備快速隨機切換能力,提高了多視點立體視頻的應(yīng)用范圍。本文的主要研究工作如下： (1)針對多視點立體視頻中現(xiàn)有的深度估計準確性差的問題,本文研究了如何快速準確的提取多視點立體視頻的深度圖用于后續(xù)編碼算法。包括如何在多視點立體視頻的多個視點的圖像上找出尺度不變的特征點,并建立特征點的對應(yīng)關(guān)系,然后利用特征點的關(guān)系使用自適應(yīng)的匹配算法建立局部匹配。綜合運用了光流法、馬爾可夫隨機場等算法,可以讓初始深度圖在視覺上更舒適和保留細節(jié),并且在時間域上形成連續(xù)的深度結(jié)果,減少弱紋理區(qū)域的錯誤及異常值。 (2)根據(jù)不同視點圖像彼此的相關(guān)性和深度信息提出了快速模式選擇算法。根據(jù)鄰近視點圖像壓縮時選擇的模式來減少每個宏塊需要計算的模式數(shù)量,結(jié)合以基于閾值的提前中止模式選擇機制來進一步的加速模式選擇的流程。同時利用 運動矢量補償?shù)慕Y(jié)果去決定是否需要計算視差矢量補償,分別減少運動矢量補償 和視差矢量補償?shù)乃阉鞣秶?3)在基于可分級視頻和多視點視頻的并行化算法的研究基礎(chǔ)之上,提出 了可分級多視點視頻并行化編碼算法。針對可分級多視點立體視頻編碼的存取單 元、預(yù)測順序、編碼結(jié)構(gòu)進行了研究,使可分級多視點立體視頻編碼能獲得根據(jù) 視點的數(shù)量和擴展層的數(shù)量調(diào)整編碼的能力,‘并綜合提高了編碼性能。(4)由于在可分級多視點立體視頻的播放過程中,客戶端可以自由的選擇 不同的視點或者碼率。為了在不增加太多存儲空間但又能提高視頻的切換速度的 情況下,本文研究了通過SP幀使視頻傳輸支持無縫切換的多層可分級視頻編碼 方法。該方法根據(jù)多視點立體視頻的特點,同時具備非可分級視頻編碼的高編碼 效率和可分級視頻編碼方法的靈活性,從而在更寬的帶寬范圍內(nèi)獲得了更好的流 化視頻服務(wù)質(zhì)量,并且減少了視頻占用存儲空間的大小。綜上,本文以可分級多視點立體視頻的編碼效率為目標,在視點間相關(guān)性的 基礎(chǔ)上,分別對深度圖生成、模式選擇、快速估計、并行編碼和碼流切換等問題 進行了深入研究,并給出了相關(guān)的仿真實驗與性能分析結(jié)果。
[Abstract]:With the rapid development of computer hardware and stereoscopic display technology , multi - viewpoint stereoscopic video gradually enters our life . Multi - view stereoscopic video includes the integration application of different viewpoint videos , and the multi - view stereoscopic video system can also provide the interactivity between the viewer and the playing system .

With respect to the traditional video , the data of multi - view stereoscopic video is much larger , and there is great similarity among the viewpoints , so it is very important to develop high - efficiency multi - view stereo video compression technology . In order to achieve the stereoscopic video interactive response of arbitrary viewpoint , the parallax information and the switching information needed by each viewpoint video data and interactive presentation system are indispensable , and how to effectively compress these information will be the focus of future multi - viewpoint stereo video compression technology .

While studying multi - viewpoint stereo video coding , the client hardware environment and the network environment need to be considered at the same time . Especially recently with the improvement of mobile phone computing power , it is no longer a dream to watch digital TV through mobile phone . However , because of the difference of network environment and packet transmission behavior , it is necessary to deal with the characteristics of network environment and packet transmission , how to adjust the current code rate of multi - view video rapidly with the existing bandwidth condition , so as to improve system performance and video quality service quality .

In this paper , based on the feature of multi - view stereo video , how to extract the depth map of multi - view stereo video is studied by multi - viewpoint stereo video , and the reference architecture of multi - view stereo video coding is optimized , the coding efficiency of multi - view video is improved . Finally , a scalable multi - view stereo video coding parallel architecture is proposed . Finally , a scalable multi - view stereo video coding scheme is proposed , which makes the video data stream have fast random switching capability and improves the application scope of multi - view stereo video .

( 1 ) Aiming at the problem of poor accuracy of existing depth estimation in multi - viewpoint stereo video , this paper studied how to extract the depth map of multi - view stereo video quickly and accurately for the subsequent coding algorithm .

( 2 ) A fast mode selection algorithm is proposed according to the correlation and depth information of different viewpoint images with each other .

the result of motion vector compensation determines whether to calculate disparity vector compensation , respectively , reduce motion vector compensation ,

and ( 3 ) based on the research of parallelizing algorithm based on scalable video and multi - view video ,

The invention relates to a scalable multi - view video parallel coding algorithm ,

Meta , prediction order and coding structure are studied , so that scalable multi - view stereo video coding can be obtained .

the number of viewpoints and the number of spreading layers adjust the coding ability , ' and the coding performance is improved comprehensively . ( 4 ) the client can freely choose because the number of viewpoints can be freely selected during the playing process of the scalable multi - view stereoscopic video in order to improve the switching speed of the video without adding too much storage space , In this paper , the multi - layer scalable video coding for seamless switching of video transmission through SP frames is studied in this paper . The method is based on the characteristics of multi - view stereoscopic video and simultaneously has high coding of non - scalable video coding . Efficiency and scalability of scalable video coding methods to get better streams over a wider bandwidth range In this paper , based on the coding efficiency of scalable multi - view stereo video , this paper focuses on the correlation among the viewpoints . On the base , the problems such as depth map generation , mode selection , fast estimation , parallel encoding and code stream switching are discussed . The results of simulation experiments and performance analysis are also given .
【學(xué)位授予單位】：武漢大學(xué)
【學(xué)位級別】：博士
【學(xué)位授予年份】：2014
【分類號】：TN919.81

【參考文獻】

相關(guān)期刊論文 前4條

1 王愛紅;王瓊?cè)A;李大海;陶宇虹;趙仁亮;趙悟翔;;三維立體顯示技術(shù)(英文)[J];電子器件;2008年01期

2 張艷;安平;張秋聞;王元慶;張兆楊;;Non-reference virtual view quality evaluation of MVD[J];Journal of Shanghai University(English Edition);2011年04期

3 汪洋;王元慶;;多用戶自由立體顯示技術(shù)[J];液晶與顯示;2009年03期

4 ;Color compensation for multi-view video coding based on diversity of cameras[J];Journal of Zhejiang University(Science A:An International Applied Physics & Engineering Journal);2008年12期

，

本文編號：1997175