面向海量高清視頻數(shù)據(jù)的高性能分布式存儲(chǔ)系統(tǒng)
發(fā)布時(shí)間:2018-03-17 10:43
本文選題:海量存儲(chǔ) 切入點(diǎn):視頻存儲(chǔ) 出處:《軟件學(xué)報(bào)》2017年08期 論文類(lèi)型:期刊論文
【摘要】:通過(guò)對(duì)視頻監(jiān)控?cái)?shù)據(jù)的特點(diǎn)和傳統(tǒng)存儲(chǔ)方案進(jìn)行分析,提出一種高性能分布式存儲(chǔ)系統(tǒng)解決方案.不同于傳統(tǒng)的基于文件存儲(chǔ)的方式,設(shè)計(jì)了一種邏輯卷結(jié)構(gòu),將非結(jié)構(gòu)化的視頻流數(shù)據(jù)以此結(jié)構(gòu)進(jìn)行組織并直接寫(xiě)入RAW磁盤(pán)設(shè)備,解決了傳統(tǒng)存儲(chǔ)方案中隨機(jī)磁盤(pán)讀寫(xiě)和磁盤(pán)碎片導(dǎo)致存儲(chǔ)性能下降的問(wèn)題.該方案將元數(shù)據(jù)組織為兩級(jí)索引結(jié)構(gòu),分別由狀態(tài)管理器和存儲(chǔ)服務(wù)器管理,極大地減少了狀態(tài)管理器需要管理元數(shù)據(jù)的數(shù)量,消除了性能瓶頸,并提供了精確到秒級(jí)的檢索精度.此外,該方案靈活的存儲(chǔ)服務(wù)器分組策略和組內(nèi)互備關(guān)系使得存儲(chǔ)系統(tǒng)具備容錯(cuò)能力和線(xiàn)性擴(kuò)展能力.系統(tǒng)測(cè)試結(jié)果表明,該方案在成本低廉的PC服務(wù)器上實(shí)現(xiàn)了單臺(tái)服務(wù)器可同時(shí)記錄400路1080P視頻流,寫(xiě)入速度是本地文件系統(tǒng)的2.5倍.
[Abstract]:By analyzing the characteristics of video surveillance data and the traditional storage scheme, presents a solution of high performance distributed storage system. File storage based on the way different from the traditional design, a logical volume structure, non structured video data stream based on the structure of the organization and write directly to RAW disk devices, to solve the traditional random read and write disk storage scheme and storage disk fragmentation leads to the problem of declining performance. The program will be organized into two level index structure of metadata, respectively by the state management and storage management server, which greatly reduces the number of state manager to manage the metadata, eliminate performance bottlenecks, and to provide accurate retrieval precision seconds class. In addition, the flexible storage server grouping strategies and intragroup preparation makes storage system has the fault-tolerant ability and linear expansion capability. The test results show that the scheme implements a single server on a low cost PC server. It can record 400 1080P video streams at the same time, and the writing speed is 2.5 times that of the local file system.
【作者單位】: 武漢光電國(guó)家實(shí)驗(yàn)室(華中科技大學(xué));華中科技大學(xué)計(jì)算機(jī)科學(xué)與技術(shù)學(xué)院;
【基金】:國(guó)家重點(diǎn)研發(fā)計(jì)劃(2016YFB1000202)~~
【分類(lèi)號(hào)】:TN948.6;TP333
【相似文獻(xiàn)】
相關(guān)碩士學(xué)位論文 前1條
1 陳霄;分布式噴泉碼在分布式存儲(chǔ)系統(tǒng)中的應(yīng)用模型與方法研究[D];電子科技大學(xué);2013年
,本文編號(hào):1624387
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1624387.html
最近更新
教材專(zhuān)著