【摘要】：自20世紀(jì)90年代以來(lái),分布式存儲(chǔ)系統(tǒng)逐漸在存儲(chǔ)業(yè)界嶄露頭角,也逐步進(jìn)入到各種關(guān)鍵應(yīng)用領(lǐng)域,其數(shù)據(jù)安全性和性能也逐漸受到挑戰(zhàn)。為了確保性能,大部分分布式存儲(chǔ)系統(tǒng)以犧牲數(shù)據(jù)可靠性為代價(jià),引入了數(shù)據(jù)緩存技術(shù),導(dǎo)致分布式存儲(chǔ)系統(tǒng)面臨數(shù)據(jù)安全風(fēng)險(xiǎn)和數(shù)據(jù)一致性修復(fù)性能的挑戰(zhàn)。為了降低緩存數(shù)據(jù)丟失的風(fēng)險(xiǎn),不同的存儲(chǔ)系統(tǒng)引入了不同的技術(shù)。磁盤(pán)陣列存儲(chǔ)系統(tǒng)通常采用電池來(lái)保護(hù)內(nèi)存中的數(shù)據(jù),部分分布式存儲(chǔ)系統(tǒng)也采用帶電池保護(hù)的內(nèi)存進(jìn)行數(shù)據(jù)保護(hù);大部分分布式存儲(chǔ)系統(tǒng),采用緩存?zhèn)浞菁夹g(shù),將緩存數(shù)據(jù)同時(shí)備份到多個(gè)節(jié)點(diǎn),以降低單個(gè)節(jié)點(diǎn)斷電帶來(lái)的影響。隨著技術(shù)的發(fā)展,在系統(tǒng)掉電時(shí)采用超級(jí)電容保證數(shù)據(jù)從內(nèi)存到閃存安全轉(zhuǎn)移的非易失性內(nèi)存模組NVDIMM(non-volaitle dual inline memory module)逐漸成熟,Intel當(dāng)前一代的處理器已經(jīng)將NVDIMM作為標(biāo)準(zhǔn)支持設(shè)備。本研究擬將NVDIMM應(yīng)用于分布式存儲(chǔ)系統(tǒng),為整個(gè)系統(tǒng)提供數(shù)據(jù)緩存掉電保護(hù)功能,提升分布式存儲(chǔ)系統(tǒng)的數(shù)據(jù)安全性及性能。為此本文提出一種NVDIMM緩存的使用管理方式,實(shí)現(xiàn)對(duì)緩存數(shù)據(jù)的全方位保護(hù),確保在分布式存儲(chǔ)系統(tǒng)出現(xiàn)掉電等故障后,通過(guò)簡(jiǎn)單的數(shù)據(jù)恢復(fù)策略,保證不出現(xiàn)數(shù)據(jù)丟失的情況。為了保證數(shù)據(jù)一致性,本文詳細(xì)設(shè)計(jì)了基于NVDIMM的分布式日志策略,保證分布式存儲(chǔ)系統(tǒng)掉電后多節(jié)點(diǎn)數(shù)據(jù)的一致性。另外,由于分布式存儲(chǔ)系統(tǒng)存儲(chǔ)的文件數(shù)量非常多,故障恢復(fù)時(shí)間較長(zhǎng),本文針對(duì)性的提出了基于NVDIMM的數(shù)據(jù)一致性修復(fù)策略,保證掉電系統(tǒng)恢復(fù)后,能夠?qū)⒑Ａ啃∥募䲠?shù)據(jù)快速修復(fù)到完整狀態(tài)。通過(guò)以上的研究,可以基于NVDIMM構(gòu)建完整的分布式存儲(chǔ)系統(tǒng)的緩存數(shù)據(jù)保護(hù)方案。本文作者利用實(shí)際的測(cè)試驗(yàn)證了NVDIMM緩存數(shù)據(jù)保護(hù)的效果。主要包含異常掉電后的數(shù)據(jù)保護(hù)、數(shù)據(jù)讀寫(xiě)性能和數(shù)據(jù)一致性修復(fù)性能的提高等。根據(jù)這些實(shí)際評(píng)測(cè)的結(jié)果,部署了NVDIMM的分布式存儲(chǔ)系統(tǒng)可以在數(shù)據(jù)節(jié)點(diǎn)異常掉電的情況下對(duì)數(shù)據(jù)進(jìn)行保護(hù),并使得寫(xiě)帶寬提高34.11%,寫(xiě)操作響應(yīng)時(shí)間縮短25.75%,海量小文件時(shí)異常斷電后數(shù)據(jù)修復(fù)的速度提升約20倍。
[Abstract]:Since the 1990s, distributed storage systems have gradually emerged in the storage industry, and gradually entered into various key applications, and their data security and performance have been gradually challenged. In order to ensure performance, most distributed storage systems introduce data cache technology at the expense of data reliability, which makes distributed storage systems face the challenge of data security risk and data consistency repair performance. In order to reduce the risk of cache data loss, different storage systems introduce different technologies. Disk array storage systems usually use batteries to protect the data in memory, and some distributed storage systems also use memory with battery protection for data protection. Most distributed storage systems use cache backup technology to backup cached data to multiple nodes at the same time in order to reduce the impact of single node power failure. With the development of technology, the non-volatile memory module NVDIMM (non-volaitle dual inline memory module), which can safely transfer the data from memory to flash memory, is becoming more and more mature when the system is power down. Intel's current generation of processors already uses NVDIMM as a standard support device. In this study, NVDIMM is applied to the distributed storage system to provide the whole system with the function of data buffering and power-off protection, and to improve the data security and performance of the distributed storage system. In this paper, a management method of NVDIMM cache is proposed, which can protect the cache data in all directions and ensure that the data will not be lost by a simple data recovery strategy after the failure of distributed storage system such as power failure. In order to ensure data consistency, the distributed log strategy based on NVDIMM is designed in detail to ensure the consistency of multi-node data after the distributed storage system power down. In addition, due to the large number of files stored in distributed storage system and the long time of fault recovery, this paper puts forward a data consistency repair strategy based on NVDIMM to ensure the recovery of power failure system. Large amount of small file data can be quickly repaired to the full state. Through the above research, we can construct a complete cache data protection scheme of distributed storage system based on NVDIMM. The author verifies the effectiveness of NVDIMM cache data protection by actual test. It mainly includes the data protection after abnormal power failure, the improvement of data read and write performance and data consistency repair performance. According to these practical results, the distributed storage system with NVDIMM can protect the data in the case of abnormal power loss of the data node, increase the write bandwidth by 34.11, and shorten the response time of the write operation by 25.75. Massive small files when abnormal power failure after the speed of data repair about 20 times.
【學(xué)位授予單位】：中國(guó)科學(xué)院大學(xué)(中國(guó)科學(xué)院工程管理與信息技術(shù)學(xué)院)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP333

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 ;廉價(jià)、高效、穩(wěn)定 微軟新一代分布式存儲(chǔ)系統(tǒng)[J];新電腦;2006年06期

2 何公明;張?jiān)獫?;面向數(shù)字媒體的高性能分布式存儲(chǔ)系統(tǒng)的研究與應(yīng)用[J];廣播電視信息;2009年10期

3 范劍波,郭建康;分布式存儲(chǔ)系統(tǒng)性能模型的建立與應(yīng)用[J];計(jì)算機(jī)工程與應(yīng)用;2001年13期

4 范劍波,徐利浩;分布式存儲(chǔ)系統(tǒng)可靠性的研究[J];計(jì)算機(jī)工程;2001年06期

5 吳英;謝廣軍;劉t，

本文編號(hào)：2408731