基于GPU的高清視頻虛擬融合技術(shù)研究
發(fā)布時(shí)間:2018-03-13 16:04
本文選題:虛擬廣告 切入點(diǎn):GPU 出處:《杭州電子科技大學(xué)》2013年碩士論文 論文類型:學(xué)位論文
【摘要】:隨著電子產(chǎn)業(yè)的發(fā)展、硬件成本下降以及圖像視頻處理各種算法不斷推陳出新,視頻處理技術(shù)在工業(yè)、商業(yè)以及民用方面已經(jīng)達(dá)到實(shí)用的階段。在視頻處理技術(shù)快速發(fā)展的環(huán)境下,,虛擬廣告系統(tǒng)應(yīng)運(yùn)而生。虛擬廣告技術(shù)在電視節(jié)目播出中提供大量虛擬信息,如三維動(dòng)畫(huà)、虛擬廣告牌、虛擬信息提示等。這些虛擬信息提供大量觀眾單純從節(jié)目本身無(wú)法或很難得到的信息,不僅豐富了節(jié)目的內(nèi)容,而且還提供了新的廣告形式,能產(chǎn)生巨大的經(jīng)濟(jì)效益和社會(huì)效益。虛擬融合技術(shù)使得虛擬物體與視頻場(chǎng)景在幾何位置和光色度上保持一致性,虛擬物體完全融入到視頻場(chǎng)景中,給觀眾強(qiáng)烈的真實(shí)感。本文主要對(duì)高清體育視頻中實(shí)時(shí)攝像機(jī)運(yùn)動(dòng)跟蹤技術(shù)和虛擬廣告區(qū)域快速前景分割技術(shù)進(jìn)行了研究,旨在研究虛擬融合技術(shù)在高清數(shù)字視頻時(shí)代的可行性和實(shí)用性。 首先,設(shè)計(jì)并實(shí)現(xiàn)了高清音視頻同步采集系統(tǒng),實(shí)時(shí)采集HD-SDI高清音視頻數(shù)據(jù)。本文采用DirectShow來(lái)實(shí)現(xiàn)高清音視頻的采集功能。高清音視頻同步采集系統(tǒng)可以針對(duì)不同的視頻采集卡進(jìn)行高清音視頻采集,并實(shí)現(xiàn)了Filter過(guò)濾器中的回調(diào)函數(shù),可以在回調(diào)函數(shù)中實(shí)現(xiàn)對(duì)視頻的融合以及為其他模塊處理提供視頻流數(shù)據(jù)。 其次,利用GPU中CUDA框架的并行運(yùn)算和高速浮點(diǎn)計(jì)算特性,提出并實(shí)現(xiàn)了基于GPU的攝像機(jī)運(yùn)動(dòng)跟蹤算法。論文闡述了基于自然特征點(diǎn)匹配的運(yùn)動(dòng)跟蹤算法和基于Hough空間變換的運(yùn)動(dòng)跟蹤算法的具體實(shí)現(xiàn)流程。通過(guò)GPU加速和優(yōu)化的攝像機(jī)運(yùn)動(dòng)跟蹤算法,將求解場(chǎng)地線端點(diǎn)信息和獲得攝像機(jī)的投影變換矩陣的時(shí)間消耗,從每幀193ms提升到了每幀16ms,大大提高了攝像機(jī)跟蹤算法在處理高清視頻的能力。 最后,提出了基于可靠背景模型的運(yùn)動(dòng)目標(biāo)分割算法和基于GPU的運(yùn)動(dòng)目標(biāo)分割算法;诳煽勘尘澳P偷倪\(yùn)動(dòng)目標(biāo)分割算法能夠達(dá)到了準(zhǔn)確分割前景目標(biāo)的要求,但在實(shí)際應(yīng)用中卻發(fā)現(xiàn)存在相機(jī)大幅度移動(dòng)和高清視頻大數(shù)據(jù)實(shí)時(shí)處理問(wèn)題;贕PU的運(yùn)動(dòng)目標(biāo)分割算法,主要利用GPU并行處理技術(shù)來(lái)動(dòng)態(tài)構(gòu)建背景模型和分割運(yùn)動(dòng)目標(biāo);贕PU的運(yùn)動(dòng)目標(biāo)分割算法技術(shù)很好地解決了攝像機(jī)移動(dòng)和高清視頻大數(shù)據(jù)量實(shí)時(shí)處理的問(wèn)題。 本文提出的高清視虛擬融合技術(shù)的可行性在高清音視頻采集融合系統(tǒng)中得到充分驗(yàn)證。系統(tǒng)表明這幾項(xiàng)技術(shù)在不同體育視頻中具有較好的實(shí)用效果。
[Abstract]:With the development of electronic industry, hardware cost reduction and a variety of video processing algorithms constantly, video processing technology in the industrial, commercial and civil areas has reached the practical stage. In the environment of the rapid development of video processing technology, virtual advertising system came into being. Virtual advertising in the TV broadcast to provide a large number of virtual information, such as 3D animation, virtual billboards, virtual information. These virtual information to provide a large number of viewers simply from the program itself unable or difficult to get information, not only enrich the content of the program, but also to provide a new form of advertising, can produce enormous economic benefits and social benefits. The virtual fusiontechnology makes virtual objects and video scene to maintain consistency in geometry and light, virtual objects are fully integrated into the video scene, give the audience a strong sense of reality. In this paper, the real-time camera motion tracking technology and the fast foreground segmentation technology of virtual advertising area are studied, aiming at studying the feasibility and practicability of virtual fusion technology in the era of high-definition digital video.
First of all, the design and implementation of synchronous acquisition system of high-definition video, real-time HD-SDI HD audio and video data. This paper uses DirectShow to achieve high-definition audio and video capture functions. HD audio and video synchronization acquisition system for different video capture card for high-definition audio and video acquisition, and Filter callback function in the filter, can be realized the video fusion and provide video data for other modules in the callback function.
Secondly, based on the characteristics of computing parallel computing and high-speed floating-point CUDA GPU framework, proposed and implemented cameramotion tracking algorithm based on GPU. This paper expounds the motion tracking algorithm based on natural feature point matching and tracking algorithm in Hough space transform based motion tracking algorithm. Through the specific implementation process of GPU acceleration and optimization of camera motion that time will solve the field line endpoint information and projection transform matrix of camera consumption increased from 193ms per frame to 16ms per frame, greatly improving the camera tracking algorithm in the ability to handle HD video.
Finally, this paper proposed a moving object segmentation algorithm and reliable background model GPU based moving object segmentation algorithm based on background model. Reliable moving target segmentation algorithm to achieve accurate segmentation of foreground objects based on the requirements, but in practice there exist the problem of real-time processing and camera greatly mobile HD video data segmentation algorithm. The moving target based on GPU, the main use of GPU parallel construct background model and segmentation of moving objects in dynamic processing technology. GPU moving target segmentation algorithm solves the mobile camera and HD video data real-time processing based on the problem.
The feasibility of the HDV virtual fusion technology presented in this paper is fully verified in HD audio and video acquisition and fusion system. The system shows that these technologies have good practical effects in different sports videos.
【學(xué)位授予單位】:杭州電子科技大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2013
【分類號(hào)】:TP391.41
【參考文獻(xiàn)】
相關(guān)期刊論文 前10條
1 謝志揚(yáng);史萍;;網(wǎng)絡(luò)不良視頻信息過(guò)濾系統(tǒng)的研究與實(shí)現(xiàn)[J];中國(guó)傳媒大學(xué)學(xué)報(bào)(自然科學(xué)版);2009年04期
2 趙彩紅;左敏;;基于Directshow的視頻抓圖在車(chē)牌識(shí)別系統(tǒng)中的應(yīng)用[J];北京工商大學(xué)學(xué)報(bào)(自然科學(xué)版);2008年01期
3 魯敏,郁文賢,鮑虎軍,匡綱要;基于機(jī)電跟蹤的三維虛擬演播室系統(tǒng)[J];電子學(xué)報(bào);2003年S1期
4 張斐;;淺議基于COM的組件化程序設(shè)計(jì)方法[J];硅谷;2011年02期
5 陳臨強(qiáng);呂梁;;基于特征塊統(tǒng)計(jì)的攝像機(jī)跟蹤算法[J];計(jì)算機(jī)工程與應(yīng)用;2008年15期
6 王建宇,劉哲,周獻(xiàn)中;虛擬廣告系統(tǒng)多線程并行模式[J];計(jì)算機(jī)工程;2003年22期
7 杜威,廖永s
本文編號(hào):1607104
本文鏈接:http://sikaile.net/wenyilunwen/guanggaoshejilunwen/1607104.html
最近更新
教材專著