本文選題：超大規(guī)模數(shù)據(jù) + 地震數(shù)據(jù)��； 參考：《吉林大學(xué)》2013年碩士論文

【摘要】：隨著計(jì)算機(jī)技術(shù)的飛速發(fā)展，在地理勘探領(lǐng)域中，深部探測(cè)會(huì)產(chǎn)生超大規(guī)模地震數(shù)據(jù)SEGY文件，其文件規(guī)模能達(dá)到Gigabyte，甚至Terabyte量級(jí)。傳統(tǒng)的地學(xué)應(yīng)用在數(shù)據(jù)處理過(guò)程中采用一次加載、反復(fù)使用的模式。但是，當(dāng)數(shù)據(jù)規(guī)模遠(yuǎn)超內(nèi)存時(shí)，將不能使用傳統(tǒng)加載模式對(duì)數(shù)據(jù)進(jìn)行處理。為此，地震數(shù)據(jù)需要采用文件格式與內(nèi)存管理兩種手段支持超大規(guī)模數(shù)據(jù)。這種超大規(guī)模地震數(shù)據(jù)的處理手段目前被國(guó)外技術(shù)壟斷。 本文作者所在研究團(tuán)隊(duì)在參照國(guó)外VSG公司制作的商業(yè)軟件Open Inventor，基于八叉樹(shù)結(jié)構(gòu)創(chuàng)建了一種面向大規(guī)模數(shù)據(jù)的文件組織體系LDM。本文實(shí)現(xiàn)了應(yīng)用于地理超大規(guī)模地震數(shù)據(jù)LDM展示的內(nèi)存管理模塊。本文設(shè)計(jì)并研制了內(nèi)存管理模塊,其中包括緩沖區(qū)管理組件和優(yōu)先級(jí)管理組件兩部分：緩沖區(qū)管理組件負(fù)責(zé)內(nèi)存緩存和數(shù)據(jù)空間的管理，以及合理的分配內(nèi)存資源；優(yōu)先級(jí)管理組件負(fù)責(zé)使內(nèi)存保留下一時(shí)刻最可能被訪問(wèn)的數(shù)據(jù)塊，并支持優(yōu)先級(jí)插件的可擴(kuò)展功能以及用戶自定義優(yōu)先級(jí)算法的導(dǎo)入。緩沖區(qū)管理組件能同時(shí)對(duì)多個(gè)載入內(nèi)存的地震數(shù)據(jù)文件同時(shí)管理并支持文件緩沖區(qū)大小的動(dòng)態(tài)變化。優(yōu)先級(jí)管理組件支持多個(gè)優(yōu)先級(jí)算法的協(xié)同工作，并利用多線程手段實(shí)現(xiàn)單一文件優(yōu)先級(jí)的管理和快速響應(yīng)。優(yōu)先級(jí)管理組件預(yù)先提供給用戶幾種經(jīng)典優(yōu)先級(jí)算法，其中包括先進(jìn)先出，最近最少使用等典型算法。在整個(gè)論文的最后一部分，本模塊以可視化應(yīng)用為例進(jìn)行測(cè)試，能夠支持?jǐn)?shù)據(jù)規(guī)模達(dá)到內(nèi)存20倍大小的地震數(shù)據(jù)的載入，顯示，并支持多分辨率的實(shí)時(shí)切換。本模塊分別以不同內(nèi)存大小，訪問(wèn)次數(shù)，，隨機(jī)條件，文件塊訪問(wèn)頻率創(chuàng)建多組測(cè)試條件，以命中率為衡量基準(zhǔn)設(shè)計(jì)了模擬實(shí)驗(yàn)。實(shí)驗(yàn)結(jié)果證明，先進(jìn)先出算法與最近最少使用算法使用效果良好，且內(nèi)存管理模塊在最近最少使用算法中能取得3%至30%的加速效果。
[Abstract]:With the rapid development of computer technology, in the field of geographical exploration, deep exploration will produce very large scale seismic data SEGY files, whose file size can reach the order of gigabyte or even Terabyte. In the process of data processing, the traditional geoscience uses the mode of once loading and repeated use. However, when the data size is much larger than the memory, the traditional loading mode will not be used to process the data. Therefore, seismic data should be supported by two methods: file format and memory management. This super-large-scale seismic data processing means are currently monopolized by foreign technology. Referring to the commercial software Open inventor produced by VSG Company abroad, the author of this paper has created a file organization system based on octree structure for large scale data. In this paper, a memory management module applied to LDM display of geographic large scale seismic data is implemented. This paper designs and develops memory management module, which includes buffer management component and priority management component: buffer management component is responsible for memory cache and data space management, and rational allocation of memory resources; The priority management component is responsible for keeping the most accessible data blocks in memory at the next moment, and supports the extensibility of the priority plug-in and the import of user-defined priority algorithms. The buffer management component can simultaneously manage and support the dynamic changes of file buffer size for multiple seismic data files loaded in memory at the same time. The priority management component supports the cooperative work of multiple priority algorithms, and realizes the management and fast response of single file priority by multithreading. Priority management components provide users with several classic priority algorithms, including first-in-first-out (FIFO), least recently used, and other typical algorithms. In the last part of the whole paper, this module can support the loading and displaying of seismic data with 20 times the size of memory, and the real-time switching of multi-resolution with visual application as an example. In this module, different memory sizes, access times, random conditions, and file block access frequency are used to create multiple test conditions, and simulation experiments are designed based on hit rate. The experimental results show that the first-in-first-out (FIFO) algorithm and the least recently used algorithm have good results, and the memory management module can achieve an acceleration effect of 3% to 30% in the most recent least use algorithm.
【學(xué)位授予單位】：吉林大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2013
【分類號(hào)】：TP333.1

【參考文獻(xiàn)】

相關(guān)期刊論文 前7條

1 劉斌;;一種正態(tài)分布隨機(jī)數(shù)的生成方法[J];電腦編程技巧與維護(hù);2010年22期

2 鮑東星;李曉明;;一種基于近似LRU算法的高緩方案[J];計(jì)算機(jī)工程;2007年09期

3 蔣理;彭四偉;;多線程實(shí)時(shí)三維渲染引擎文件系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[J];計(jì)算機(jī)應(yīng)用與軟件;2010年06期

4 劉俞;Linux多線程的互斥與同步控制及實(shí)踐[J];安徽冶金科技職業(yè)學(xué)院學(xué)報(bào);2005年02期

5 劉秀娟;高抒;鄒文;王西林;;淺地層剖面儀SEGY型數(shù)據(jù)文件的讀取[J];物探化探計(jì)算技術(shù);2007年03期

6 肖梅,劉國(guó)華,李慶春;在VC++環(huán)境下讀取地震勘探SEG-Y格式數(shù)據(jù)及其應(yīng)用[J];中國(guó)科技信息;2005年09期

7 朱響斌 ,唐敏 ,董金祥;一種基于八叉樹(shù)的三維實(shí)體內(nèi)部可視化技術(shù)[J];中國(guó)圖象圖形學(xué)報(bào);2002年03期

相關(guān)博士學(xué)位論文 前1條

1 田新華;面向性能優(yōu)化的壓縮cache技術(shù)研究[D];國(guó)防科學(xué)技術(shù)大學(xué);2007年

相關(guān)碩士學(xué)位論文 前2條

1 洪功存;通用FIFO的設(shè)計(jì)及其應(yīng)用[D];華中科技大學(xué);2004年

2 王玉娟;大地震數(shù)據(jù)體的存儲(chǔ)優(yōu)化及抽取算法研究[D];中國(guó)海洋大學(xué);2009年

本文編號(hào)：1809734