發(fā)布時間：2018-04-02 10:13

  本文選題：磁盤存儲系統(tǒng)　切入點：預(yù)取　出處：《華中科技大學(xué)》2012年博士論文

【摘要】：磁盤占據(jù)數(shù)據(jù)中心數(shù)據(jù)存儲的統(tǒng)治性地位,磁盤的節(jié)能控制對降低數(shù)據(jù)中心總運營成本和節(jié)能減排都具有重要意義。然而,磁盤的節(jié)能控制在實際系統(tǒng)的運用中卻存在諸多困難和挑戰(zhàn)。磁盤能耗狀態(tài)的轉(zhuǎn)換過程需要耗費較長的時間和較多的電能,容易造成系統(tǒng)讀寫服務(wù)的響應(yīng)時間延遲,并且會影響磁盤的使用壽命,以往基于緩沖區(qū)預(yù)取的磁盤節(jié)能方法,大多未就系統(tǒng)性能和磁盤壽命進行綜合考慮。另一方面,對單個磁盤的節(jié)能控制會影響數(shù)據(jù)中心存儲系統(tǒng)的整體性能。研究保證磁盤可靠性和系統(tǒng)總體性能的能耗感知預(yù)取技術(shù)以及磁盤存儲系統(tǒng)的自組織節(jié)能行為,是一項重要和緊迫的研究課題。 圍繞基于預(yù)取的磁盤存儲系統(tǒng)節(jié)能技術(shù),從理論分析、系統(tǒng)設(shè)計和實驗測試得出了以下一些研究成果。 現(xiàn)有的能耗感知貪婪式預(yù)取方法PGP (Power-aware Greedy Prefetching),通過將請求數(shù)據(jù)提前讀入內(nèi)存增大磁盤空閑時間間隔,是一種啟發(fā)式的、具有一定實際效果的磁盤節(jié)能方法。在對PGP的預(yù)取機制分析中,發(fā)現(xiàn)PGP未對預(yù)取的啟動時間和預(yù)取長度進行分析。進一步研究發(fā)現(xiàn)磁盤的空閑時間序列可能因預(yù)取啟動時間和預(yù)取長度變化而變化,從而導(dǎo)致磁盤的總節(jié)電量減少和能耗狀態(tài)轉(zhuǎn)換次數(shù)增加。綜合磁盤本身的屬性、任務(wù)序列整體性能要求、磁盤的節(jié)能以及磁盤可靠性,建立了針對大規(guī)模數(shù)據(jù)中心磁盤存儲系統(tǒng)的能耗感知預(yù)取優(yōu)化框架。 建立了針對單磁盤單數(shù)據(jù)流能耗感知預(yù)取優(yōu)化模型DiscPOP,磁盤的節(jié)能目標(biāo)函數(shù)和約束條件被證明為0-1整型線性規(guī)劃問題。磁盤空閑時間序列過長,導(dǎo)致求解DiscPOP最優(yōu)解的復(fù)雜度提高。貪婪分割算法是一種離線的、分而治之的策略,過濾掉磁盤空閑時間序列中的連續(xù)無效序列,將總的空閑時間序列分割成較短的子序列,通過線性規(guī)劃解決器得到各個子序列的能耗感知預(yù)取最優(yōu)解。提出了基于延緩開始機制的能耗感知預(yù)取在線算法,通過簡單的控制條件,使得系統(tǒng)智能地選定一個啟動點進行能耗感知預(yù)取,達到節(jié)能優(yōu)化和磁盤能耗周期轉(zhuǎn)換次數(shù)減少的目標(biāo)。利用基于庫存論的供應(yīng)鏈管理模型,提出應(yīng)用于多數(shù)據(jù)流的單磁盤能耗感知預(yù)取方法。通過對磁盤進行分組,利用單磁盤能耗感知預(yù)取最優(yōu)解,提出一種2-競爭性的多磁盤能耗感知預(yù)取優(yōu)化方法,并擴展至多組磁盤或者具有鏡像磁盤的結(jié)構(gòu)中。經(jīng)實驗驗證,DiscPOP及其擴展方案降低了磁盤能耗并減少了磁盤能耗轉(zhuǎn)換周期次數(shù)。 研究固態(tài)盤和DRAM (Dynamic Random Access Memory.動態(tài)隨機存儲內(nèi)存)組成混合緩存結(jié)構(gòu)的能耗感知預(yù)取方法。通過對多順序流的異步預(yù)取分析,發(fā)現(xiàn)混合緩存中的固態(tài)盤不僅會產(chǎn)生嚴(yán)重的寫放大問題,還會產(chǎn)生嚴(yán)重的交織隨機讀寫負載。提出了三個針對混合緩存的能耗感知預(yù)取優(yōu)化規(guī)則,分別是通過對順序流進行分類動態(tài)調(diào)整預(yù)取長度和觸發(fā)距離、將不同到達速率的順序流數(shù)據(jù)分別緩存在固態(tài)盤和DRAM上以及將固態(tài)盤上同一個順序流的部分異步預(yù)取數(shù)據(jù)緩存于DRAM中消除交織讀寫情況。基于這三個預(yù)取規(guī)則提出了一種啟發(fā)式的、面向混合緩存的協(xié)同式自適應(yīng)能耗感知預(yù)取算法CAP,并重新設(shè)計緩存設(shè)備固態(tài)盤上的頁面管理機制,降低固態(tài)盤作緩存時產(chǎn)生的碎片程度。經(jīng)實驗驗證,CAP提高了系統(tǒng)的吞吐量,減少了固態(tài)盤寫入速度,并優(yōu)化了磁盤上的空閑空間序列,減少了磁盤的耗電量。 提出了一種針對數(shù)據(jù)中心大規(guī)模磁盤存儲系統(tǒng)的理想化能耗優(yōu)化數(shù)據(jù)布局方法。依照數(shù)據(jù)訪問的頻度篩選出熱點數(shù)據(jù),并將其多個副本按照分組分別存儲在各個磁盤組上,為大規(guī)模磁盤存儲系統(tǒng)提供與能耗成比例的服務(wù),需要打開的磁盤個數(shù)與需要提供的數(shù)據(jù)訪問吞吐量成正比。利用動力學(xué)方法建立了一個針對大規(guī)模磁盤存儲系統(tǒng)節(jié)能分析的二維元胞自動機模型。分析數(shù)據(jù)中心大規(guī)模磁盤存儲系統(tǒng)的自組織性和自我調(diào)節(jié)能力,通過局部數(shù)據(jù)節(jié)點的能耗感知預(yù)取和數(shù)據(jù)遷移等行為,利用簡單的狀態(tài)轉(zhuǎn)換規(guī)則,模擬和分析局部磁盤節(jié)能行為對系統(tǒng)整體性能和能耗的影響。實驗結(jié)果表明,整個系統(tǒng)性能和節(jié)點狀態(tài)隨著局部磁盤的調(diào)控,元胞狀態(tài)呈現(xiàn)出復(fù)雜的時空演化現(xiàn)象,副本個數(shù)隨著負載的增加而增多并趨于穩(wěn)定。在負載到達速度較低的情況下,各個磁盤的等待隊列長度熵出現(xiàn)近似的冪律分布,整個系統(tǒng)的節(jié)能行為表現(xiàn)出一定的自組織特性。
[Abstract]:Disk data storage data center occupies the dominant position, energy saving control disk is of great significance to reduce data center total operating costs and energy saving and emission reduction. However, the energy saving control disk has many difficulties and challenges in the application in practical system. The conversion state of the disk energy consumption process takes longer and more power, easy to cause the system to read write service response time delay, and will affect the service life of the disk, the disk based energy saving method of buffer prefetching, mostly not on the system performance and the life of the disk into consideration. On the other hand, will affect the overall performance of the storage system of data center energy saving control of a single disk study on self organization behavior. To ensure such energy aware reliability and overall performance of pre fetching system disk and disk storage system, is an important and tight A compelled research topic.
The following research results are obtained from theoretical analysis, system design and experimental test based on the energy saving technology of disk storage system based on prefetching.
Energy aware greedy type pre existing method PGP (Power-aware Greedy Prefetching), the requested data is read into memory in advance increases disk idle time interval is a heuristic, disk energy saving method has a certain practical effect. The mechanism of PGP in the pre analysis, the PGP is not found on the pre fetching start time and prefetch length is analyzed. Further study found that free time series may be due to the disk prefetching starting time and prefetch length changes, resulting in the total electricity saving and reduce energy consumption of disk transition times increased. The attribute synthetic disk itself, the overall performance requirements of task sequence, disk and disk to establish such reliability. The energy aware pre for massive disk storage system data center optimization framework.
A single data stream for single disk energy aware prefetching optimization model DiscPOP, energy saving objective function and constraint conditions of disk prove to be 0-1 integer linear programming problem. Disk idle time series is too long, lead to increased complexity of solving the DiscPOP optimal solution. The greedy segmentation algorithm is an off-line, divide and rule strategy, filtering continuous off invalid sequence disk idle time sequence, the total idle time sequence is divided into short sub sequences by linear programming to solve energy aware for each sub sequence of the pre take optimal solution. The proposed energy aware mechanism for online pre start delay algorithm based on the control condition is simple, which makes the system intelligent selection of a starting point for energy aware prefetching, achieve energy optimization and energy conversion to reduce the number of disk cycle target. Using the theory of stock based on Supply Chain The management model, proposed a single disk energy aware pre applied to multiple data streams is proposed. By grouping the disk, get the optimal solution by a single disk energy aware pre, proposed a multi disk energy aware pre 2- competitive optimization method, and set up the extended structure disk or disk image. After experimental verification, DiscPOP and its extension scheme reduces energy consumption and reduce the energy consumption of the disk disk conversion cycles.
Study on the solid state disk and DRAM (Dynamic Random Access Memory. dynamic random access memory) composed of energy aware pre mixed buffer structure is proposed. By the pre asynchronous order flow analysis, found in the mixed solid state disk cache will not only write amplification problem is serious, but also have a serious interleaving random read and write load. This three for hybrid cache energy aware prefetching rules, are classified to dynamically adjust the prefetch length and distance based on the trigger sequence flow, different arrival rate of order flow data were cached in solid state disk and DRAM and asynchronous pre solid state disk with a sequence of data flow the cache in DRAM to eliminate interleaving read and write cases. The three prefetching rules proposed a heuristic algorithm based on CAP collaborative adaptive energy aware prefetching for hybrid cache, and The design of solid state disk cache device page management mechanism, the degree of fragmentation is reduced as generated by the solid state disk cache. Experiments show that CAP improves the throughput of the system, reduce the solid state disk write speed, and the optimal sequence of free space on the disk, reduces the power consumption of the disk.
The optimization of data layout method is ideal for large-scale data center energy consumption of a disk storage system. In accordance with the frequency of data access the selected hot data, and the multiple copies are stored in each packet according to a disk group, providing proportional service and energy consumption for large scale storage system, need to open the number of disks with the need to provide data access throughput is proportional. Using the dynamic method to establish a two-dimensional cellular automaton model for large scale energy saving disk storage system analysis. Analysis of self-organization and self adjustment ability of data center scale disk storage system, the energy aware node pre local data and data migration. Using simple state transition rules, impact simulation and analysis of local disk energy saving behavior of the overall system performance and energy consumption. The experimental results Show that the performance of the whole system and node state with the regulation of local disk, the cellular state showing the evolution of complex spatial phenomena, a number of copies as the load increases and tends to be stable. When the load reaches a lower speed, each disk queue length entropy shows power-law distribution approximation, energy saving the behavior of the system exhibits self-organizing characteristic.

【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級別】：博士
【學(xué)位授予年份】：2012
【分類號】：TP333.35

【參考文獻】

相關(guān)期刊論文 前4條

1 葛雄資;馮丹;陸承濤;金超;;綠色網(wǎng)絡(luò)存儲系統(tǒng)的動力學(xué)分析模型[J];計算機科學(xué);2011年08期

2 陳茂科,李星;不完全活動的分組交換格點網(wǎng)絡(luò)模型的行為[J];計算機學(xué)報;2005年07期

3 袁堅,任勇,山秀明;一種計算機網(wǎng)絡(luò)的元胞自動機模型及分析[J];物理學(xué)報;2000年03期

4 袁堅,任勇,劉鋒,山秀明;復(fù)雜計算機網(wǎng)絡(luò)中的相變和整體關(guān)聯(lián)行為[J];物理學(xué)報;2001年07期

相關(guān)博士學(xué)位論文 前1條

1 吳峰光;Linux內(nèi)核中的預(yù)取算法[D];中國科學(xué)技術(shù)大學(xué);2008年

，

本文編號：1699913