本文選題：數(shù)據(jù)遷移 + 分級存儲��； 參考：《華中科技大學》2013年碩士論文

【摘要】：分級存儲的設計初衷是將數(shù)據(jù)按訪問熱度的不同存儲于不同性能的存儲設備上，最大化存儲利用率。當數(shù)據(jù)的熱度發(fā)生變化時，便將數(shù)據(jù)遷移至更符合其當前熱度值的存儲設備上。因此，對于分級存儲系統(tǒng)而言，設計對前臺應用透明、高效的數(shù)據(jù)遷移機制具有重要的研究價值。 遷移過程主要分為三個模塊來設計：熱度統(tǒng)計模塊、策略匹配模塊以及數(shù)據(jù)遷移模塊。熱度統(tǒng)計模塊在通用塊層實現(xiàn)訪問頻度計數(shù)，支持基于訪問頻度與時間權(quán)重值的熱度評價。策略匹配模塊建立可定制的策略規(guī)則和通用規(guī)則，設計了基于物理卷（PV）占用率的閾值動態(tài)調(diào)整算法和基于存儲節(jié)點負載均衡的PV申請算法。數(shù)據(jù)遷移模塊實現(xiàn)三種能夠斷點續(xù)傳的數(shù)據(jù)遷移算法：（1）將讀取的源卷數(shù)據(jù)塊寫入目的卷對應數(shù)據(jù)塊的簡單數(shù)據(jù)遷移算法（SCP）；（2）基于Device-mapper中內(nèi)核復制線程（kcopy）并實現(xiàn)數(shù)據(jù)一致性的數(shù)據(jù)遷移算法（I-kcopy）；（3）基于SCP遷移并實現(xiàn)讀寫并行的數(shù)據(jù)遷移算法（RWCP）。另外，為保障遷移后數(shù)據(jù)的一致性，設計并分析了基于記錄-寫策略的一致性方案，以及基于分段處理的一致性方案。 具體實現(xiàn)了數(shù)據(jù)遷移機制的原型HSDM_COPY，并對其數(shù)據(jù)遷移速度及數(shù)據(jù)遷移過程中對用戶性能的影響兩個方面進行測試。實驗數(shù)據(jù)表明，在高負載強度的情況下，數(shù)據(jù)遷移使磁盤吞吐率下降10%~25%，，在正常情況下，數(shù)據(jù)遷移基本不影響用戶對系統(tǒng)的正常訪問。
[Abstract]:Hierarchical storage is designed to maximize storage utilization by storing data on storage devices with different performance according to access heat. When the heat of the data changes, the data is migrated to a storage device that is more consistent with its current heat value. Therefore, for hierarchical storage system, the design has important research value for transparent and efficient data migration mechanism of foreground application. The migration process is mainly divided into three modules: heat statistics module, policy matching module and data migration module. The thermal statistics module realizes the access frequency count in the general block layer and supports the heat evaluation based on the access frequency and time weight. The policy matching module establishes customizable policy rules and general rules, and designs a threshold dynamic adjustment algorithm based on PVR) occupancy and a PV application algorithm based on storage node load balancing. The data migration module implements three data migration algorithms: 1) which can continuously transfer data from breakpoints) writes the read source volume data block into the corresponding data block of the destination volume and a simple data migration algorithm based on the kernel copy thread in Device-mapper. Based on SCP, a parallel data migration algorithm based on SCP is implemented. In addition, in order to ensure the consistency of the migrated data, the consistency scheme based on the record-write strategy and the consistency scheme based on segmentation are designed and analyzed. The prototype of data migration mechanism, HSDM COPYY, is implemented, and its data migration speed and the impact on user performance in the process of data migration are tested. The experimental data show that under the condition of high load intensity, data migration reduces disk throughput by 10% and 25%. Under normal conditions, data migration basically does not affect users' normal access to the system.
【學位授予單位】：華中科技大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TP333

【參考文獻】

相關(guān)期刊論文 前10條

1 肖竟華;黃革新;;Linux虛擬文件系統(tǒng)實現(xiàn)技術(shù)探討[J];電腦與信息技術(shù);2006年01期

2 喬靜;屈志強;李娟;;Linux服務器安全動態(tài)磁盤管理方案[J];電腦知識與技術(shù);2010年23期

3 郭松;謝維波;;Linux下Proc文件系統(tǒng)的編程剖析[J];華僑大學學報(自然科學版);2010年05期

4 馬海潮;周明光;郭金虎;;計算機測試系統(tǒng)發(fā)展綜述[J];航天控制;2007年02期

5 宋麗娜;戴華東;任怡;;基于海量數(shù)據(jù)存儲系統(tǒng)多級存儲介質(zhì)的熱點數(shù)據(jù)區(qū)分方法[J];計算機研究與發(fā)展;2012年S1期

6 張芳;Linux系統(tǒng)下設備驅(qū)動程序解析[J];湖南科技學院學報;2005年11期

7 胡風華,游智勇,李恪;存儲系統(tǒng)中的Snapshot技術(shù)研究[J];計算機工程與應用;2004年01期

8 張成峰;謝長生;羅益輝;羅東健;;網(wǎng)絡存儲的統(tǒng)一與虛擬化[J];計算機科學;2006年06期

9 裴燦浩;謝長生;黃建忠;;基于讀寫優(yōu)化的內(nèi)核級加密文件系統(tǒng)[J];計算機工程;2010年15期

10 韓德志,謝長生,李懷陽;存儲備份技術(shù)探析[J];計算機應用研究;2004年06期

本文編號：1869212