發(fā)布時間：2019-01-20 19:27

【摘要】：隨著大數(shù)據(jù)、云計(jì)算等概念的提出與興起,分布式存儲技術(shù)的價值和重要性日漸凸顯。相比于傳統(tǒng)的集中式存儲系統(tǒng),分布式存儲系統(tǒng)具有低成本、易擴(kuò)展、高可用等優(yōu)勢。然而,分布式存儲的架構(gòu)體系也為數(shù)據(jù)復(fù)制和同步帶來了諸多挑戰(zhàn)。首先,由于分布式存儲系統(tǒng)建立在異步通信環(huán)境之上,且系統(tǒng)中各數(shù)據(jù)節(jié)點(diǎn)存在發(fā)生不可預(yù)計(jì)故障的情況,使得分布式存儲系統(tǒng)實(shí)現(xiàn)數(shù)據(jù)一致非常困難。其次,根據(jù)CAP理論,數(shù)據(jù)強(qiáng)一致性和系統(tǒng)可用性、分區(qū)容錯性之間存在相互制約的關(guān)系,如何在保證數(shù)據(jù)一致性的前提下綜合與其他因素間的權(quán)衡是一項(xiàng)極具挑戰(zhàn)的課題。針對上述問題,本文根據(jù)分布式存儲系統(tǒng)的特點(diǎn),在現(xiàn)有數(shù)據(jù)一致性理論的基礎(chǔ)上,實(shí)現(xiàn)了基于Paxos協(xié)議的分布式數(shù)據(jù)一致性模塊。然后,通過對一致性過程的優(yōu)化和改進(jìn),提出了流程簡化、可用性高且讀寫同步的數(shù)據(jù)一致性協(xié)議設(shè)計(jì)。本文的主要研究內(nèi)容和結(jié)果歸納如下:(1)基于經(jīng)典的Paxos協(xié)議,實(shí)現(xiàn)了分布式存儲系統(tǒng)數(shù)據(jù)一致性模塊。該模塊可以同時接收多個客戶端并行發(fā)送的數(shù)據(jù)操作請求,生成系統(tǒng)各個數(shù)據(jù)節(jié)點(diǎn)可獲取的相同的數(shù)據(jù)操作序列。各數(shù)據(jù)節(jié)點(diǎn)順序執(zhí)行序列中數(shù)據(jù)操作請求,就可以實(shí)現(xiàn)分布式存儲系統(tǒng)的數(shù)據(jù)最終一致性。(2)針對Paxos協(xié)議中消息傳遞次數(shù)因提議者搶占接受者訪問權(quán)而增多,導(dǎo)致協(xié)議延遲增大的問題,通過延長提案編號有效范圍的方式優(yōu)化了Paxos協(xié)議的運(yùn)行過程,進(jìn)而提高了數(shù)據(jù)一致性模塊的每秒查詢率。(3)針對基于Paxos協(xié)議實(shí)現(xiàn)的分布式存儲系統(tǒng)數(shù)據(jù)一致性模塊只能達(dá)到數(shù)據(jù)的最終一致性程度,而無法實(shí)現(xiàn)數(shù)據(jù)的同步讀寫的問題,通過選舉分布式存儲系統(tǒng)中的一個數(shù)據(jù)節(jié)點(diǎn)作為唯一接受客戶端請求節(jié)點(diǎn)的方式,為數(shù)據(jù)一致性模塊提供了數(shù)據(jù)同步讀寫的功能。最后,本文對提出的數(shù)據(jù)一致性協(xié)議進(jìn)行了實(shí)驗(yàn),通過對若干關(guān)鍵指標(biāo)的檢測,證明了本文所提方法的正確性和有效性。
[Abstract]:With the development of big data and cloud computing, the value and importance of distributed storage technology are becoming more and more important. Compared with the traditional centralized storage system, distributed storage system has the advantages of low cost, easy expansion and high availability. However, distributed storage architecture also brings many challenges to data replication and synchronization. Firstly, the distributed storage system is built on the asynchronous communication environment, and the data nodes in the system have unpredictable failures, so it is very difficult to realize the data consistency in the distributed storage system. Secondly, according to CAP theory, there is a relationship between strong consistency of data and availability of system, and fault tolerance of partition. How to synthesize the trade-off between data consistency and other factors under the premise of data consistency is a very challenging issue. According to the characteristics of distributed storage system and the existing data consistency theory, the distributed data consistency module based on Paxos protocol is implemented in this paper. Then, through the optimization and improvement of the consistency process, the design of data consistency protocol with simplified flow, high availability and synchronous reading and writing is proposed. The main research contents and results are summarized as follows: (1) based on the classical Paxos protocol, the distributed storage system data consistency module is implemented. The module can simultaneously receive data operation requests sent by multiple clients in parallel and generate the same data operation sequences that can be obtained by each data node of the system. When each data node executes the data operation request in sequence, the data consistency of distributed storage system can be realized. (2) the number of message delivery in Paxos protocol increases because the proponent preempts the access right of the receiver. The problem that leads to the increase of protocol delay optimizes the running process of Paxos protocol by extending the valid range of proposal number. Then it improves the query rate of data consistency module per second. (3) the distributed storage system data consistency module based on Paxos protocol can only achieve the final consistency of data, but can not achieve the problem of synchronous reading and writing of data. By electing one of the data nodes in the distributed storage system as the only way to accept the client request node, the data consistency module is provided with the function of data synchronous reading and writing. Finally, the proposed data consistency protocol is tested, and the correctness and effectiveness of the proposed method are proved by the detection of some key indicators.
【學(xué)位授予單位】：哈爾濱工業(yè)大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前3條

1 李芬;朱志祥;劉盛輝;;大數(shù)據(jù)發(fā)展現(xiàn)狀及面臨的問題[J];西安郵電大學(xué)學(xué)報;2013年05期

2 王喜妹;楊壽保;王淑玲;郭良敏;;云存儲中一種自適應(yīng)的副本一致性維護(hù)機(jī)制[J];中國科學(xué)院研究生院學(xué)報;2013年01期

3 岳昆,王曉玲,周傲英;Web服務(wù)核心支撐技術(shù):研究綜述[J];軟件學(xué)報;2004年03期

相關(guān)碩士學(xué)位論文 前1條

1 游勝;網(wǎng)絡(luò)協(xié)議仿真方法及軟件實(shí)現(xiàn)關(guān)鍵技術(shù)的研究[D];湖南大學(xué);2008年

，

本文編號：2412329