基于閃存的剖分影像數(shù)據(jù)專用存儲(chǔ)技術(shù)研究
發(fā)布時(shí)間:2018-02-20 18:58
本文關(guān)鍵詞: 剖分影像數(shù)據(jù) 固態(tài)存儲(chǔ) Hilbert編碼 窗口查詢 出處:《國(guó)防科學(xué)技術(shù)大學(xué)》2012年碩士論文 論文類型:學(xué)位論文
【摘要】:剖分影像數(shù)據(jù)存儲(chǔ)一直是遙感影像信息系統(tǒng)中的關(guān)鍵問題。機(jī)械磁盤的性能提升已經(jīng)達(dá)到一定的瓶頸,它正制約著遙感影像信息系統(tǒng)的發(fā)展。由于容量大、速度快、低功耗、抗震性強(qiáng),以閃存為主要介質(zhì)的固態(tài)硬盤正逐步取代機(jī)械硬盤成為存儲(chǔ)領(lǐng)域的后起之秀。研究基于閃存的剖分影像數(shù)據(jù)專用存儲(chǔ)技術(shù),是一個(gè)很有價(jià)值的課題。 LazyFTL是一種基于多通道并行存儲(chǔ)架構(gòu)的地址映射方式,然而將它應(yīng)用到剖分影像數(shù)據(jù)存儲(chǔ)時(shí),忽視了通道間的并行化操作,存儲(chǔ)和訪問速率受到限制。本文分析了剖分影像數(shù)據(jù)量大、隨機(jī)訪問時(shí)效性高的特點(diǎn),明確了剖分影像數(shù)據(jù)快速存儲(chǔ)的性能要求,提出了一種基于Hilbert曲線的剖分影像分塊地址映射方法。在算法中,采用查找表的方法提高了任意尺寸圖像塊Hilbert編碼的計(jì)算效率,加快了圖像數(shù)據(jù)地址映射表的生成速率;采用圖像數(shù)據(jù)與元數(shù)據(jù)分開存儲(chǔ)的方式,將索引信息節(jié)點(diǎn)存儲(chǔ)到單獨(dú)的Flash物理頁中,減少了存儲(chǔ)設(shè)備啟動(dòng)時(shí)需要掃描的Flash物理頁數(shù)量,縮短了固態(tài)硬盤啟動(dòng)時(shí)間。另外,本文根據(jù)剖分影像數(shù)據(jù)訪問的特點(diǎn),提出了一種基于窗口查詢的緩存置換算法。在該算法中,改變了一般固態(tài)硬盤中基于LRU訪問頻率統(tǒng)計(jì)的置換區(qū)判斷方法,,采用一種基于空間相關(guān)性的置換區(qū)判斷方法,提高了數(shù)據(jù)訪問命中率和數(shù)據(jù)讀取速度。 實(shí)驗(yàn)結(jié)果表明,基于Hilbert曲線的剖分影像分塊地址映射方法可以獲得1.6GB/s的存儲(chǔ)速率,優(yōu)于LazyFTL的映射方式;基于窗口查詢的緩存置換算法可以獲得32.7%的緩存命中率,明顯優(yōu)于基于LRU的緩存置換算法,大大地提高數(shù)據(jù)訪問速率。
[Abstract]:The storage of partitioned image data has always been a key problem in remote sensing image information system. The performance improvement of mechanical disk has reached a certain bottleneck, which is restricting the development of remote sensing image information system. The solid state hard disk with flash memory as the main medium is gradually replacing the mechanical hard disk as a rising star in the field of storage. It is a valuable subject to study the special storage technology of split image data based on flash memory. LazyFTL is an address mapping method based on multi-channel parallel storage architecture. However, when it is applied to the storage of split image data, the parallelization operation between channels is ignored. The storage and access rate are limited. This paper analyzes the characteristics of large amount of data and high time efficiency of random access of partitioned images, and clarifies the performance requirements of fast storage of partitioned image data. In this paper, a method of segmented image block address mapping based on Hilbert curve is proposed. In the algorithm, the method of lookup table is used to improve the computational efficiency of Hilbert coding for arbitrary size image blocks, and to speed up the generation rate of image data address mapping table. The index information node is stored in a separate Flash physical page by using the method of separate storage of image data and metadata, which reduces the number of Flash physical pages that need to be scanned when the storage device starts, and shortens the startup time of solid state hard disk. In this paper, according to the characteristics of data access in subdivision image, a cache permutation algorithm based on window query is proposed. In this algorithm, the permutation region judgment method based on LRU access frequency statistics in general solid-state hard disk is changed. A new method based on spatial correlation is used to judge the permutation area, which improves the hit rate of data access and the speed of data reading. The experimental results show that the block address mapping method based on Hilbert curve can obtain the storage rate of 1.6 GB / s, which is superior to that of LazyFTL, and the cache replacement algorithm based on window query can obtain a cache hit ratio of 32.7%. It is obviously superior to the cache replacement algorithm based on LRU, and greatly improves the data access rate.
【學(xué)位授予單位】:國(guó)防科學(xué)技術(shù)大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2012
【分類號(hào)】:TP333
【參考文獻(xiàn)】
相關(guān)期刊論文 前5條
1 肖恰;程承旗;關(guān)麗;古琳;;基于球面離散格網(wǎng)的遙感數(shù)據(jù)剖分編目模型研究[J];測(cè)繪科學(xué);2010年03期
2 黃華,張建剛,許魯;藍(lán)鯨分布式文件系統(tǒng)的分布式分層資源管理模型[J];計(jì)算機(jī)研究與發(fā)展;2005年06期
3 龐博文;李國(guó)慶;;基于C/S結(jié)構(gòu)的大數(shù)據(jù)量遙感圖像顯示方案[J];科學(xué)技術(shù)與工程;2008年14期
4 ;P3Stor: A parallel, durable flash-based SSD for enterprise-scale storage systems[J];Science China(Information Sciences);2011年06期
5 田國(guó)良;我國(guó)遙感應(yīng)用現(xiàn)狀、問題與建議[J];遙感信息;2003年02期
本文編號(hào):1519769
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1519769.html
最近更新
教材專著