海量硬盤數(shù)據(jù)快速復(fù)制技術(shù)研究與實現(xiàn)
發(fā)布時間:2018-06-30 17:57
本文選題:快速復(fù)制 + 磁盤解析 ; 參考:《南京航空航天大學(xué)》2012年碩士論文
【摘要】:信息技術(shù)日新月異,必然要求信息傳輸速度更快更強(qiáng),隨著數(shù)字化地球的日趨形成,數(shù)字化信息存儲量呈現(xiàn)爆炸式發(fā)展,海量磁盤隨之出現(xiàn),這對海量硬盤數(shù)據(jù)的快速復(fù)制提出了新的要求。本文在深入了解國內(nèi)外有關(guān)數(shù)據(jù)快速復(fù)制技術(shù)的基礎(chǔ)上,就目前數(shù)據(jù)快速復(fù)制應(yīng)用場景與模式進(jìn)行了深入的分析,針對當(dāng)前國內(nèi)外有關(guān)硬盤數(shù)據(jù)復(fù)制系統(tǒng)存在的弱點以及復(fù)制速率已經(jīng)達(dá)到極限等問題,提出一種基于多塊位多接口并發(fā)輸出的數(shù)據(jù)復(fù)制策略,并就此展開研究。 論文提出基于主機(jī)多個數(shù)據(jù)輸出接口進(jìn)行并發(fā)數(shù)據(jù)輸出的數(shù)據(jù)復(fù)制機(jī)制,并圍繞該目標(biāo)展開相關(guān)研究并加以實現(xiàn)。主要做的工作如下: (1)構(gòu)建了磁盤文件系統(tǒng)快速解析模型。通過對硬盤的物理結(jié)構(gòu)特性、數(shù)據(jù)結(jié)構(gòu)特性、磁盤文件系統(tǒng)、硬盤數(shù)據(jù)存儲原理進(jìn)行了深入分析,提出了磁盤文件系統(tǒng)快速識別技術(shù)、文件系統(tǒng)驅(qū)動技術(shù),實現(xiàn)了磁盤文件系統(tǒng)的快速解析。 (2)提出了“單模接口數(shù)據(jù)并發(fā)輸出”與“多模接口數(shù)據(jù)并發(fā)輸出”兩種數(shù)據(jù)輸出策略,并完成了數(shù)據(jù)輸出的整體架構(gòu)建設(shè)。設(shè)計了數(shù)據(jù)輸出實行塊位輸出的策略模式,通過測試與實驗得出最優(yōu)塊位劃分策略表,并設(shè)計出進(jìn)行多線數(shù)據(jù)傳輸、塊位數(shù)據(jù)流向以及數(shù)據(jù)輸出整體架構(gòu)方案。 (3)研究了塊位劃分算法、塊位派發(fā)與接收算法,并對其進(jìn)行測試,驗證該策略與算法的可行性與有效性。提出數(shù)據(jù)散列存儲與重組方案策略,并通過自定義數(shù)據(jù)元結(jié)構(gòu)協(xié)議,對數(shù)據(jù)元散列存儲進(jìn)行分析,設(shè)計出數(shù)據(jù)元散列式存儲方案,并對其進(jìn)行了實現(xiàn),,然后依據(jù)數(shù)據(jù)元散列存儲協(xié)議,對基于散列式存儲數(shù)據(jù)元的重組進(jìn)行研究,設(shè)計并實現(xiàn)“快速重組”與“全息重組”兩種散列數(shù)據(jù)重組模式。 (4)在技術(shù)研究基礎(chǔ)上實現(xiàn)了原型系統(tǒng)的開發(fā),并進(jìn)行了性能測試,達(dá)到了預(yù)期的目標(biāo)。在對相關(guān)技術(shù)與應(yīng)用策略深入研究的基礎(chǔ)上,根據(jù)課題研究目標(biāo),對課題提出的海量硬盤數(shù)據(jù)快速復(fù)制系統(tǒng)的應(yīng)用需求進(jìn)行分析,進(jìn)而對系統(tǒng)的硬件設(shè)計與軟件集成進(jìn)行了實現(xiàn),最后對研制出的系統(tǒng)原型系統(tǒng)進(jìn)行功能測試與性能分析,測試結(jié)果表明了系統(tǒng)的有效性,達(dá)到了預(yù)期的研究目標(biāo)。
[Abstract]:With the rapid development of information technology, the speed of information transmission is bound to be faster and stronger. With the formation of digital earth, the amount of digital information storage presents explosive development, and mass disks appear. This puts forward new requirements for the fast copy of massive hard disk data. On the basis of deep understanding of domestic and foreign rapid data replication technology, this paper makes a deep analysis of the current data rapid replication application scenarios and patterns. Aiming at the weakness of hard disk data replication system at home and abroad and the limitation of replication rate, a data replication strategy based on multi-bit and multi-interface concurrent output is proposed and studied. This paper proposes a data replication mechanism for concurrent data output based on multiple host data output interfaces, and carries out related research and implementation around this goal. The main work is as follows: (1) A fast parsing model of disk file system is built. By analyzing the physical structure characteristic, data structure characteristic, disk file system and hard disk data storage principle of hard disk, the paper puts forward the fast recognition technology of disk file system, file system driving technology, The fast parsing of disk file system is realized. (2) two kinds of data output strategies, "single mode interface data concurrent output" and "multimode interface data concurrent output", are proposed, and the whole data output architecture is completed. The strategy mode of block bit output for data output is designed. The optimal block bit partition strategy table is obtained by testing and experiment, and the multi-line data transmission is designed. The whole architecture of block bit data flow and data output. (3) the block bit partition algorithm, block bit dispatch and receiving algorithm are studied and tested to verify the feasibility and effectiveness of the strategy and algorithm. The strategy of data hash storage and recombination is put forward, and the scheme of data element hash storage is designed and implemented by analyzing the data element hash storage through the self-defined data element structure protocol. Then, according to the hash storage protocol of data element, the recombination of data element based on hash storage is studied. Two kinds of hash data recombination modes are designed and implemented. (4) the prototype system is developed on the basis of technical research, and the performance test is carried out, and the expected goal is achieved. On the basis of deep research on related technology and application strategy, according to the research goal, the paper analyzes the application requirements of the mass hard disk data fast copy system put forward by the subject. Then the hardware design and software integration of the system are realized. Finally, the function test and performance analysis of the developed prototype system are carried out. The test results show that the system is effective and achieves the expected research goal.
【學(xué)位授予單位】:南京航空航天大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2012
【分類號】:TP333
【參考文獻(xiàn)】
相關(guān)期刊論文 前5條
1 余新平,王宏遠(yuǎn);采用DMA技術(shù)實現(xiàn)高速數(shù)據(jù)傳輸?shù)腎/O接口卡設(shè)計[J];電子技術(shù)應(yīng)用;1999年07期
2 王芳,張江陵,馮丹;RAID的并行I/O調(diào)度算法分析[J];計算機(jī)工程與科學(xué);2003年02期
3 王玲,錢華林;計算機(jī)取證技術(shù)及其發(fā)展趨勢[J];軟件學(xué)報;2003年09期
4 王瑞峰;;用ADSP2106X外部握手方式DMA實現(xiàn)高速數(shù)據(jù)采集[J];計算機(jī)工程與設(shè)計;2008年03期
5 賈惠波,張緒綱;連續(xù)數(shù)據(jù)記錄中的緩存策略[J];微計算機(jī)信息;2001年02期
本文編號:2086359
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2086359.html
最近更新
教材專著