本文選題：圖像拼接 + 虛擬現(xiàn)實(shí)�。� 參考：《電子科技大學(xué)》2017年碩士論文

【摘要】：虛擬現(xiàn)實(shí)(Virtual Reality,VR)技術(shù)普及和市場(chǎng)拓展在最近五年有一次大的飛躍。特別是VR 360全景視頻的商業(yè)應(yīng)用已經(jīng)走入千家萬(wàn)戶,進(jìn)入了快速發(fā)展時(shí)期。人們對(duì)主觀質(zhì)量、沉浸式感受的需求越來(lái)越高導(dǎo)致高分辨率、高動(dòng)態(tài)范圍的全景視頻數(shù)據(jù)量驟升。這直接引發(fā)了VR視頻數(shù)據(jù)在傳輸和儲(chǔ)存兩個(gè)方面同時(shí)面臨更大挑戰(zhàn)。因此,研究VR全景視頻合成和編碼壓縮具有強(qiáng)烈的現(xiàn)實(shí)急迫性。論文以全景視頻圖像的融合、拼接、編碼相關(guān)技術(shù)為主要研究?jī)?nèi)容,具體地,在四個(gè)方面展開工作。(1)實(shí)現(xiàn)全景視頻圖像采集、預(yù)處理、配準(zhǔn)到融合的全過(guò)程。基于正六面體六鏡頭攝像機(jī)采集的視頻數(shù)據(jù),采用棋盤標(biāo)定法對(duì)相機(jī)進(jìn)行標(biāo)定,采用白平衡算法解決圖像色差一致性問(wèn)題。將六幅圖像映射到球面,采用SIFT算法進(jìn)行配準(zhǔn),采用重疊區(qū)域線性過(guò)渡法進(jìn)行融合,最后生成VR 360全景視頻圖像。(2)分析VR球面圖到平面圖的多種映射格式,選擇最佳全景視頻編碼輸入格式。分析對(duì)比圓柱體、六面體、八面體、二十面體、新型瓦片分割等映射轉(zhuǎn)換方式在編碼性能、主客觀質(zhì)量及計(jì)算量方面的差異。驗(yàn)證得出六面體是目前最佳的編碼輸入格式的結(jié)論。(3)基于圖像融合拼接技術(shù)提出全景視頻運(yùn)動(dòng)估值越界折疊搜索算法。利用全景視頻圖像左右邊界的連續(xù)性,運(yùn)動(dòng)補(bǔ)償時(shí)通過(guò)圖像拼接技術(shù)將重構(gòu)幀左右邊界進(jìn)行拼接融合,降低運(yùn)動(dòng)估值搜索匹配塊的誤差,提升了編碼效率。(4)針對(duì)CIS掃描儀掃描圖像去噪提出了一種光柵條紋去除算法。分析了CIS掃描儀物理結(jié)構(gòu),建立了光柵條紋噪聲數(shù)學(xué)模型,提出了傅里葉函數(shù)算法,有效去除了圖像的條紋噪聲。上述四個(gè)方面的工作有望為全景視頻融合、拼接、編碼的算法研究提供一些有益參考。在全景圖像融合與拼接算法方面達(dá)到了合成全景圖像平滑自然,具有較好的主觀質(zhì)量。對(duì)多種VR球面圖到平面圖映射格式測(cè)試結(jié)果表明,六面體為現(xiàn)有的優(yōu)于經(jīng)緯圖的映射格式,建議作為全景視頻編碼輸入格式的主要選擇。全景視頻運(yùn)動(dòng)估值折疊算法能夠找到失真更小的匹配塊,有效提升了編碼效率。光柵條紋去除算法能有效去除CIS掃描圖像噪聲,且比現(xiàn)有噪聲去除算法效果更佳。
[Abstract]:Virtual reality (VR) technology popularization and market expansion have made a big leap in the last five years. In particular, the commercial application of VR 360 panoramic video has entered a rapid development period. The increasing demand for subjective quality and immersive experience leads to a surge of panoramic video data with high resolution and high dynamic range. This directly leads to greater challenges for VR video data transmission and storage at the same time. Therefore, it is urgent to study VR panoramic video synthesis and coding compression. In this paper, the fusion, splicing and coding technologies of panoramic video images are taken as the main research contents. Specifically, the whole process of panoramic video image acquisition, preprocessing, registration and fusion is realized in four aspects. Based on the video data collected by the hexahedron six-shot camera, the camera is calibrated by the checkerboard calibration method, and the consistency of the image color difference is solved by the white balance algorithm. The six images are mapped to the sphere, the SIFT algorithm is used for registration, and the overlapping region linear transition method is used to fuse the image. Finally, the VR 360 panoramic video image. 2) is generated to analyze the various mapping formats from the VR spherical image to the plane map. Select the best panoramic video encoding input format. The differences of coding performance, subjective and objective quality and computational complexity between cylindrical, hexahedron, octahedron, icosahedron and new tile segmentation are analyzed and compared. The conclusion is that hexahedron is the best coding input format at present. Based on image fusion and stitching technology, the paper proposes an algorithm for searching panoramic video motion estimation by overstepping folding. Using the continuity of the left and right boundaries of panoramic video images, the reconstructed frame left and right boundaries are stitched and fused in motion compensation, which reduces the error of motion estimation search matching block. A raster stripe removal algorithm is proposed for CIS scanner image denoising. The physical structure of CIS scanner is analyzed, the mathematical model of grating fringe noise is established, and the Fourier function algorithm is proposed to remove the fringe noise effectively. These four aspects are expected to provide some useful references for the research of panoramic video fusion, mosaic and coding algorithms. In the aspect of panoramic image fusion and stitching algorithm, the synthetic panoramic image is smooth and natural, and has good subjective quality. The test results show that the hexahedron is a better mapping format than longitude and weft map. It is suggested that it is the main choice of input format for panoramic video coding. Panoramic video motion estimation folding algorithm can find matching blocks with less distortion, which effectively improves the coding efficiency. Raster stripe removal algorithm can effectively remove the noise of CIS scanning image, and the effect is better than the existing noise removal algorithm.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP391.41

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 蘭紅;洪玉歡;高曉林;;面向全景拼接的圖像配準(zhǔn)技術(shù)研究及應(yīng)用[J];計(jì)算機(jī)工程與科學(xué);2016年02期

2 楊磊;曹劍中;唐利孬;高博;王華;郭惠楠;;全景圖像自動(dòng)拼接算法的優(yōu)化設(shè)計(jì)[J];紅外與激光工程;2014年03期

3 王峰;魏惠月;韋欣;宋國(guó)峰;徐濤;彭曉世;劉慎業(yè);;全光掃描裝置設(shè)計(jì)及實(shí)驗(yàn)研究[J];強(qiáng)激光與粒子束;2013年09期

4 戴春來(lái);;基于自由度分析的幾何約束凝聚計(jì)算方法的改進(jìn)[J];計(jì)算機(jī)工程與應(yīng)用;2011年14期

5 蒲亮;葉玉堂;宋昀岑;劉莉;陳東明;潘明;;基于優(yōu)化K-D樹的大面積高密度PCB快速AOI[J];儀器儀表學(xué)報(bào);2011年04期

6 苗立剛;;視頻監(jiān)控中的圖像拼接與合成算法研究[J];儀器儀表學(xué)報(bào);2009年04期

7 侯舒維,郭寶龍;一種圖像自動(dòng)拼接的快速算法[J];計(jì)算機(jī)工程;2005年15期

8 陳勁松,邵蕓,朱博勤;中分辨率遙感圖像條帶噪聲的去除[J];遙感學(xué)報(bào);2004年03期

9 趙向陽(yáng),杜利民;一種全自動(dòng)穩(wěn)健的圖像拼接融合算法[J];中國(guó)圖象圖形學(xué)報(bào);2004年04期

10 楊忠東,張文建,李俊,W.Paul Menzel,Richard A.Frey;應(yīng)用小波收縮方法剔除MODIS熱紅外波段數(shù)據(jù)條帶噪聲[J];遙感學(xué)報(bào);2004年01期

，

本文編號(hào)：1908031