一種高速數(shù)據(jù)存儲方法的研究
發(fā)布時間:2018-10-17 12:23
【摘要】:信息技術(shù)的高速發(fā)展推動人類社會全面進入數(shù)字時代,突出表現(xiàn)在信息總量和交換量的迅猛增長,不斷出現(xiàn)新興的應(yīng)用領(lǐng)域。傳輸、處理和存儲如此龐大的數(shù)據(jù)量使存儲系統(tǒng)面臨前所未有的機遇和挑戰(zhàn)。 數(shù)據(jù)傳輸和數(shù)據(jù)存儲是存儲系統(tǒng)中的最重要的兩個環(huán)節(jié),本文以地震油氣勘探儀器系統(tǒng)應(yīng)用為背景,探索利用現(xiàn)有的普適設(shè)備最大性能的發(fā)揮網(wǎng)絡(luò)帶寬和磁盤驅(qū)動器吞吐量的方式。當(dāng)前通用計算機的組織架構(gòu)在處理網(wǎng)絡(luò)通信和數(shù)據(jù)存儲的過程中至少需要經(jīng)歷從網(wǎng)絡(luò)到內(nèi)存,再從內(nèi)存到磁盤的兩次數(shù)據(jù)拷貝,加之頻繁的中斷處理使其難以執(zhí)行高速、持續(xù)、可靠的數(shù)據(jù)傳輸和存儲。因此,本文在對當(dāng)前的數(shù)據(jù)存儲系統(tǒng)進行研究的基礎(chǔ)上,設(shè)計了一種高速數(shù)據(jù)傳輸、存儲的原型。該原型充分利用FPGA在并行事件處理上的優(yōu)勢,降低處理器在傳輸、存儲協(xié)議上的負(fù)擔(dān)和中斷處理頻率,實現(xiàn)了低功耗、小成本的數(shù)據(jù)存儲系統(tǒng);同時,也使處理器可以將更多的資源用于算法處理與數(shù)據(jù)運算。 本論文共分為以下五章: 第一章作為緒論,從存儲需求出發(fā),介紹了存儲設(shè)備和存儲系統(tǒng)的評價標(biāo)準(zhǔn)。在分析當(dāng)前儀器對數(shù)據(jù)傳輸、處理和存儲的基本需求以及現(xiàn)有通用計算機平臺的吞吐瓶頸的基礎(chǔ)上,通過不同方案的對比,提出基于硬件實現(xiàn)的存儲原型設(shè)計。 第二章從基本存儲設(shè)備出發(fā),介紹了擴展存儲系統(tǒng)容量、提升存儲系統(tǒng)性能、增強存儲系統(tǒng)可靠性的方法。為了進一步理解存儲系統(tǒng)的運行,討論了存儲通道和接口的實現(xiàn)方法。最后針對存儲系統(tǒng)的設(shè)計方法,簡要分析了數(shù)據(jù)存儲優(yōu)化的途徑。 第三章詳細(xì)敘述了研制存儲原型過程中硬件實現(xiàn)的技術(shù)路線與細(xì)節(jié)。分別從時鐘、復(fù)位、接口與總線以及電源等多個方面闡明系統(tǒng)設(shè)計。重點介紹了在數(shù)據(jù)傳輸、存儲過程中扮演重要角色的基于千兆以太網(wǎng)的可靠數(shù)據(jù)傳輸和Serial ATA接口的原理、分析和實現(xiàn)。 第四章給出了已完成的初步測試結(jié)果,包括數(shù)字時鐘同步所實現(xiàn)的同步精度,基于千兆以太網(wǎng)的可靠數(shù)據(jù)傳輸?shù)耐掏铝?Serial ATA接口與磁盤驅(qū)動器的鏈路初始化結(jié)果以及PCI Express的吞吐量,并對測試結(jié)果進行了討論。 最后是整篇論文的總結(jié)與展望,以本原型系統(tǒng)為平臺,為繼續(xù)開展數(shù)據(jù)傳輸、處理和存儲的深入研究提出建議。
[Abstract]:The rapid development of information technology promotes the human society to enter the digital age in an all-round way, which is highlighted by the rapid growth of the total amount of information and the amount of exchange, and the emergence of new application fields. Transmission, processing and storage of such a large amount of data makes storage system facing unprecedented opportunities and challenges. Data transmission and data storage are the two most important links in the storage system. The background of this paper is the application of seismic oil and gas exploration instrument system. Explore ways to maximize network bandwidth and disk drive throughput using existing pervasive devices. In the process of processing network communication and data storage, the current organizational structure of a general-purpose computer needs at least two copies of data from network to memory, and then from memory to disk, together with frequent interrupt processing, which makes it difficult to carry out high-speed and continuous operations. Reliable data transmission and storage. Therefore, based on the research of current data storage system, this paper designs a prototype of high speed data transmission and storage. The prototype makes full use of the advantage of FPGA in parallel event processing, reduces the burden of processor in transmission, storage protocol and interrupt processing frequency, and realizes a low power and low cost data storage system. It also allows the processor to devote more resources to algorithm processing and data operations. This paper is divided into the following five chapters: the first chapter as an introduction, from the storage requirements, introduced the storage equipment and storage system evaluation criteria. On the basis of analyzing the basic requirements of data transmission, processing and storage of the current instrument and the bottleneck of the current general computer platform, a storage prototype design based on hardware implementation is put forward through the comparison of different schemes. In the second chapter, the methods of expanding storage system capacity, improving storage system performance and enhancing storage system reliability are introduced. In order to further understand the operation of storage system, the implementation method of storage channel and interface is discussed. Finally, aiming at the design method of storage system, the paper briefly analyzes the way of data storage optimization. In the third chapter, the technical route and details of the hardware implementation in the process of developing the storage prototype are described in detail. The system design is explained from clock, reset, interface and bus, power supply and so on. The principle, analysis and implementation of reliable data transmission based on gigabit Ethernet and Serial ATA interface which play an important role in data transmission and storage process are introduced. In chapter 4, the preliminary test results are given, including the synchronization accuracy of digital clock synchronization. The throughput, Serial ATA interface of reliable data transmission based on Gigabit Ethernet, the link initialization result of disk drive and the throughput of PCI Express are discussed, and the test results are discussed. Finally, the conclusion and prospect of the whole paper are presented. Based on this prototype system, some suggestions are put forward for further research on data transmission, processing and storage.
【學(xué)位授予單位】:中國科學(xué)技術(shù)大學(xué)
【學(xué)位級別】:博士
【學(xué)位授予年份】:2013
【分類號】:TP333
本文編號:2276644
[Abstract]:The rapid development of information technology promotes the human society to enter the digital age in an all-round way, which is highlighted by the rapid growth of the total amount of information and the amount of exchange, and the emergence of new application fields. Transmission, processing and storage of such a large amount of data makes storage system facing unprecedented opportunities and challenges. Data transmission and data storage are the two most important links in the storage system. The background of this paper is the application of seismic oil and gas exploration instrument system. Explore ways to maximize network bandwidth and disk drive throughput using existing pervasive devices. In the process of processing network communication and data storage, the current organizational structure of a general-purpose computer needs at least two copies of data from network to memory, and then from memory to disk, together with frequent interrupt processing, which makes it difficult to carry out high-speed and continuous operations. Reliable data transmission and storage. Therefore, based on the research of current data storage system, this paper designs a prototype of high speed data transmission and storage. The prototype makes full use of the advantage of FPGA in parallel event processing, reduces the burden of processor in transmission, storage protocol and interrupt processing frequency, and realizes a low power and low cost data storage system. It also allows the processor to devote more resources to algorithm processing and data operations. This paper is divided into the following five chapters: the first chapter as an introduction, from the storage requirements, introduced the storage equipment and storage system evaluation criteria. On the basis of analyzing the basic requirements of data transmission, processing and storage of the current instrument and the bottleneck of the current general computer platform, a storage prototype design based on hardware implementation is put forward through the comparison of different schemes. In the second chapter, the methods of expanding storage system capacity, improving storage system performance and enhancing storage system reliability are introduced. In order to further understand the operation of storage system, the implementation method of storage channel and interface is discussed. Finally, aiming at the design method of storage system, the paper briefly analyzes the way of data storage optimization. In the third chapter, the technical route and details of the hardware implementation in the process of developing the storage prototype are described in detail. The system design is explained from clock, reset, interface and bus, power supply and so on. The principle, analysis and implementation of reliable data transmission based on gigabit Ethernet and Serial ATA interface which play an important role in data transmission and storage process are introduced. In chapter 4, the preliminary test results are given, including the synchronization accuracy of digital clock synchronization. The throughput, Serial ATA interface of reliable data transmission based on Gigabit Ethernet, the link initialization result of disk drive and the throughput of PCI Express are discussed, and the test results are discussed. Finally, the conclusion and prospect of the whole paper are presented. Based on this prototype system, some suggestions are put forward for further research on data transmission, processing and storage.
【學(xué)位授予單位】:中國科學(xué)技術(shù)大學(xué)
【學(xué)位級別】:博士
【學(xué)位授予年份】:2013
【分類號】:TP333
【共引文獻】
相關(guān)期刊論文 前5條
1 吳海超;林君;張林行;;地震儀器中應(yīng)用的網(wǎng)絡(luò)通訊技術(shù)研究[J];地球物理學(xué)進展;2012年04期
2 劉偉;;慣性傳感器在油氣資源勘探中的應(yīng)用相關(guān)技術(shù)分析[J];電子世界;2013年08期
3 王星魁;彭新光;郝瑞;;Xen虛擬機存儲方式I/O性能研究[J];太原理工大學(xué)學(xué)報;2013年05期
4 單杰;武杰;劉列峰;;基于以太網(wǎng)PHY的高速可靠數(shù)據(jù)傳輸方法實現(xiàn)[J];微型機與應(yīng)用;2013年17期
5 劉磊;趙艷彬;王本利;;考慮柔性模態(tài)的硬盤音圈電機快速精確定位控制[J];微特電機;2013年12期
,本文編號:2276644
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2276644.html
最近更新
教材專著