本文選題：磁盤存儲(chǔ)系統(tǒng)　切入點(diǎn)：預(yù)取　出處：《華中科技大學(xué)》2012年博士論文

【摘要】：磁盤占據(jù)數(shù)據(jù)中心數(shù)據(jù)存儲(chǔ)的統(tǒng)治性地位,磁盤的節(jié)能控制對(duì)降低數(shù)據(jù)中心總運(yùn)營(yíng)成本和節(jié)能減排都具有重要意義。然而,磁盤的節(jié)能控制在實(shí)際系統(tǒng)的運(yùn)用中卻存在諸多困難和挑戰(zhàn)。磁盤能耗狀態(tài)的轉(zhuǎn)換過(guò)程需要耗費(fèi)較長(zhǎng)的時(shí)間和較多的電能,容易造成系統(tǒng)讀寫服務(wù)的響應(yīng)時(shí)間延遲,并且會(huì)影響磁盤的使用壽命,以往基于緩沖區(qū)預(yù)取的磁盤節(jié)能方法,大多未就系統(tǒng)性能和磁盤壽命進(jìn)行綜合考慮。另一方面,對(duì)單個(gè)磁盤的節(jié)能控制會(huì)影響數(shù)據(jù)中心存儲(chǔ)系統(tǒng)的整體性能。研究保證磁盤可靠性和系統(tǒng)總體性能的能耗感知預(yù)取技術(shù)以及磁盤存儲(chǔ)系統(tǒng)的自組織節(jié)能行為,是一項(xiàng)重要和緊迫的研究課題。 圍繞基于預(yù)取的磁盤存儲(chǔ)系統(tǒng)節(jié)能技術(shù),從理論分析、系統(tǒng)設(shè)計(jì)和實(shí)驗(yàn)測(cè)試得出了以下一些研究成果。 現(xiàn)有的能耗感知貪婪式預(yù)取方法PGP (Power-aware Greedy Prefetching),通過(guò)將請(qǐng)求數(shù)據(jù)提前讀入內(nèi)存增大磁盤空閑時(shí)間間隔,是一種啟發(fā)式的、具有一定實(shí)際效果的磁盤節(jié)能方法。在對(duì)PGP的預(yù)取機(jī)制分析中,發(fā)現(xiàn)PGP未對(duì)預(yù)取的啟動(dòng)時(shí)間和預(yù)取長(zhǎng)度進(jìn)行分析。進(jìn)一步研究發(fā)現(xiàn)磁盤的空閑時(shí)間序列可能因預(yù)取啟動(dòng)時(shí)間和預(yù)取長(zhǎng)度變化而變化,從而導(dǎo)致磁盤的總節(jié)電量減少和能耗狀態(tài)轉(zhuǎn)換次數(shù)增加。綜合磁盤本身的屬性、任務(wù)序列整體性能要求、磁盤的節(jié)能以及磁盤可靠性,建立了針對(duì)大規(guī)模數(shù)據(jù)中心磁盤存儲(chǔ)系統(tǒng)的能耗感知預(yù)取優(yōu)化框架。 建立了針對(duì)單磁盤單數(shù)據(jù)流能耗感知預(yù)取優(yōu)化模型DiscPOP,磁盤的節(jié)能目標(biāo)函數(shù)和約束條件被證明為0-1整型線性規(guī)劃問(wèn)題。磁盤空閑時(shí)間序列過(guò)長(zhǎng),導(dǎo)致求解DiscPOP最優(yōu)解的復(fù)雜度提高。貪婪分割算法是一種離線的、分而治之的策略,過(guò)濾掉磁盤空閑時(shí)間序列中的連續(xù)無(wú)效序列,將總的空閑時(shí)間序列分割成較短的子序列,通過(guò)線性規(guī)劃解決器得到各個(gè)子序列的能耗感知預(yù)取最優(yōu)解。提出了基于延緩開(kāi)始機(jī)制的能耗感知預(yù)取在線算法,通過(guò)簡(jiǎn)單的控制條件,使得系統(tǒng)智能地選定一個(gè)啟動(dòng)點(diǎn)進(jìn)行能耗感知預(yù)取,達(dá)到節(jié)能優(yōu)化和磁盤能耗周期轉(zhuǎn)換次數(shù)減少的目標(biāo)。利用基于庫(kù)存論的供應(yīng)鏈管理模型,提出應(yīng)用于多數(shù)據(jù)流的單磁盤能耗感知預(yù)取方法。通過(guò)對(duì)磁盤進(jìn)行分組,利用單磁盤能耗感知預(yù)取最優(yōu)解,提出一種2-競(jìng)爭(zhēng)性的多磁盤能耗感知預(yù)取優(yōu)化方法,并擴(kuò)展至多組磁盤或者具有鏡像磁盤的結(jié)構(gòu)中。經(jīng)實(shí)驗(yàn)驗(yàn)證,DiscPOP及其擴(kuò)展方案降低了磁盤能耗并減少了磁盤能耗轉(zhuǎn)換周期次數(shù)。 研究固態(tài)盤和DRAM (Dynamic Random Access Memory.動(dòng)態(tài)隨機(jī)存儲(chǔ)內(nèi)存)組成混合緩存結(jié)構(gòu)的能耗感知預(yù)取方法。通過(guò)對(duì)多順序流的異步預(yù)取分析,發(fā)現(xiàn)混合緩存中的固態(tài)盤不僅會(huì)產(chǎn)生嚴(yán)重的寫放大問(wèn)題,還會(huì)產(chǎn)生嚴(yán)重的交織隨機(jī)讀寫負(fù)載。提出了三個(gè)針對(duì)混合緩存的能耗感知預(yù)取優(yōu)化規(guī)則,分別是通過(guò)對(duì)順序流進(jìn)行分類動(dòng)態(tài)調(diào)整預(yù)取長(zhǎng)度和觸發(fā)距離、將不同到達(dá)速率的順序流數(shù)據(jù)分別緩存在固態(tài)盤和DRAM上以及將固態(tài)盤上同一個(gè)順序流的部分異步預(yù)取數(shù)據(jù)緩存于DRAM中消除交織讀寫情況�；谶@三個(gè)預(yù)取規(guī)則提出了一種啟發(fā)式的、面向混合緩存的協(xié)同式自適應(yīng)能耗感知預(yù)取算法CAP,并重新設(shè)計(jì)緩存設(shè)備固態(tài)盤上的頁(yè)面管理機(jī)制,降低固態(tài)盤作緩存時(shí)產(chǎn)生的碎片程度。經(jīng)實(shí)驗(yàn)驗(yàn)證,CAP提高了系統(tǒng)的吞吐量,減少了固態(tài)盤寫入速度,并優(yōu)化了磁盤上的空閑空間序列,減少了磁盤的耗電量。 提出了一種針對(duì)數(shù)據(jù)中心大規(guī)模磁盤存儲(chǔ)系統(tǒng)的理想化能耗優(yōu)化數(shù)據(jù)布局方法。依照數(shù)據(jù)訪問(wèn)的頻度篩選出熱點(diǎn)數(shù)據(jù),并將其多個(gè)副本按照分組分別存儲(chǔ)在各個(gè)磁盤組上,為大規(guī)模磁盤存儲(chǔ)系統(tǒng)提供與能耗成比例的服務(wù),需要打開(kāi)的磁盤個(gè)數(shù)與需要提供的數(shù)據(jù)訪問(wèn)吞吐量成正比。利用動(dòng)力學(xué)方法建立了一個(gè)針對(duì)大規(guī)模磁盤存儲(chǔ)系統(tǒng)節(jié)能分析的二維元胞自動(dòng)機(jī)模型。分析數(shù)據(jù)中心大規(guī)模磁盤存儲(chǔ)系統(tǒng)的自組織性和自我調(diào)節(jié)能力,通過(guò)局部數(shù)據(jù)節(jié)點(diǎn)的能耗感知預(yù)取和數(shù)據(jù)遷移等行為,利用簡(jiǎn)單的狀態(tài)轉(zhuǎn)換規(guī)則,模擬和分析局部磁盤節(jié)能行為對(duì)系統(tǒng)整體性能和能耗的影響。實(shí)驗(yàn)結(jié)果表明,整個(gè)系統(tǒng)性能和節(jié)點(diǎn)狀態(tài)隨著局部磁盤的調(diào)控,元胞狀態(tài)呈現(xiàn)出復(fù)雜的時(shí)空演化現(xiàn)象,副本個(gè)數(shù)隨著負(fù)載的增加而增多并趨于穩(wěn)定。在負(fù)載到達(dá)速度較低的情況下,各個(gè)磁盤的等待隊(duì)列長(zhǎng)度熵出現(xiàn)近似的冪律分布,整個(gè)系統(tǒng)的節(jié)能行為表現(xiàn)出一定的自組織特性。
[Abstract]:Disk data storage data center occupies the dominant position, energy saving control disk is of great significance to reduce data center total operating costs and energy saving and emission reduction. However, the energy saving control disk has many difficulties and challenges in the application in practical system. The conversion state of the disk energy consumption process takes longer and more power, easy to cause the system to read write service response time delay, and will affect the service life of the disk, the disk based energy saving method of buffer prefetching, mostly not on the system performance and the life of the disk into consideration. On the other hand, will affect the overall performance of the storage system of data center energy saving control of a single disk study on self organization behavior. To ensure such energy aware reliability and overall performance of pre fetching system disk and disk storage system, is an important and tight A compelled research topic.
The following research results are obtained from theoretical analysis, system design and experimental test based on the energy saving technology of disk storage system based on prefetching.
Energy aware greedy type pre existing method PGP (Power-aware Greedy Prefetching), the requested data is read into memory in advance increases disk idle time interval is a heuristic, disk energy saving method has a certain practical effect. The mechanism of PGP in the pre analysis, the PGP is not found on the pre fetching start time and prefetch length is analyzed. Further study found that free time series may be due to the disk prefetching starting time and prefetch length changes, resulting in the total electricity saving and reduce energy consumption of disk transition times increased. The attribute synthetic disk itself, the overall performance requirements of task sequence, disk and disk to establish such reliability. The energy aware pre for massive disk storage system data center optimization framework.
A single data stream for single disk energy aware prefetching optimization model DiscPOP, energy saving objective function and constraint conditions of disk prove to be 0-1 integer linear programming problem. Disk idle time series is too long, lead to increased complexity of solving the DiscPOP optimal solution. The greedy segmentation algorithm is an off-line, divide and rule strategy, filtering continuous off invalid sequence disk idle time sequence, the total idle time sequence is divided into short sub sequences by linear programming to solve energy aware for each sub sequence of the pre take optimal solution. The proposed energy aware mechanism for online pre start delay algorithm based on the control condition is simple, which makes the system intelligent selection of a starting point for energy aware prefetching, achieve energy optimization and energy conversion to reduce the number of disk cycle target. Using the theory of stock based on Supply Chain The management model, proposed a single disk energy aware pre applied to multiple data streams is proposed. By grouping the disk, get the optimal solution by a single disk energy aware pre, proposed a multi disk energy aware pre 2- competitive optimization method, and set up the extended structure disk or disk image. After experimental verification, DiscPOP and its extension scheme reduces energy consumption and reduce the energy consumption of the disk disk conversion cycles.
Study on the solid state disk and DRAM (Dynamic Random Access Memory. dynamic random access memory) composed of energy aware pre mixed buffer structure is proposed. By the pre asynchronous order flow analysis, found in the mixed solid state disk cache will not only write amplification problem is serious, but also have a serious interleaving random read and write load. This three for hybrid cache energy aware prefetching rules, are classified to dynamically adjust the prefetch length and distance based on the trigger sequence flow, different arrival rate of order flow data were cached in solid state disk and DRAM and asynchronous pre solid state disk with a sequence of data flow the cache in DRAM to eliminate interleaving read and write cases. The three prefetching rules proposed a heuristic algorithm based on CAP collaborative adaptive energy aware prefetching for hybrid cache, and The design of solid state disk cache device page management mechanism, the degree of fragmentation is reduced as generated by the solid state disk cache. Experiments show that CAP improves the throughput of the system, reduce the solid state disk write speed, and the optimal sequence of free space on the disk, reduces the power consumption of the disk.
The optimization of data layout method is ideal for large-scale data center energy consumption of a disk storage system. In accordance with the frequency of data access the selected hot data, and the multiple copies are stored in each packet according to a disk group, providing proportional service and energy consumption for large scale storage system, need to open the number of disks with the need to provide data access throughput is proportional. Using the dynamic method to establish a two-dimensional cellular automaton model for large scale energy saving disk storage system analysis. Analysis of self-organization and self adjustment ability of data center scale disk storage system, the energy aware node pre local data and data migration. Using simple state transition rules, impact simulation and analysis of local disk energy saving behavior of the overall system performance and energy consumption. The experimental results Show that the performance of the whole system and node state with the regulation of local disk, the cellular state showing the evolution of complex spatial phenomena, a number of copies as the load increases and tends to be stable. When the load reaches a lower speed, each disk queue length entropy shows power-law distribution approximation, energy saving the behavior of the system exhibits self-organizing characteristic.

【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級(jí)別】：博士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333.35

【參考文獻(xiàn)】

相關(guān)期刊論文 前4條

1 葛雄資;馮丹;陸承濤;金超;;綠色網(wǎng)絡(luò)存儲(chǔ)系統(tǒng)的動(dòng)力學(xué)分析模型[J];計(jì)算機(jī)科學(xué);2011年08期

2 陳茂科,李星;不完全活動(dòng)的分組交換格點(diǎn)網(wǎng)絡(luò)模型的行為[J];計(jì)算機(jī)學(xué)報(bào);2005年07期

3 袁堅(jiān),任勇,山秀明;一種計(jì)算機(jī)網(wǎng)絡(luò)的元胞自動(dòng)機(jī)模型及分析[J];物理學(xué)報(bào);2000年03期

4 袁堅(jiān),任勇,劉鋒,山秀明;復(fù)雜計(jì)算機(jī)網(wǎng)絡(luò)中的相變和整體關(guān)聯(lián)行為[J];物理學(xué)報(bào);2001年07期

相關(guān)博士學(xué)位論文 前1條

1 吳峰光;Linux內(nèi)核中的預(yù)取算法[D];中國(guó)科學(xué)技術(shù)大學(xué);2008年

，

本文編號(hào)：1699913