本文選題：云計算 + 云存儲系統(tǒng)�。� 參考：《南京郵電大學(xué)》2017年碩士論文

【摘要】：隨著云計算技術(shù)、云存儲技術(shù)的發(fā)展,系統(tǒng)內(nèi)部產(chǎn)生的數(shù)據(jù)量呈現(xiàn)出爆炸式的增長方式。在面對海量數(shù)據(jù)的存儲與處理時,云計算技術(shù)以及云存儲技術(shù)逐漸成為當(dāng)前互聯(lián)網(wǎng)技術(shù)中主流的數(shù)據(jù)共享與處理的技術(shù)。云存儲系統(tǒng)中,經(jīng)常通過數(shù)據(jù)復(fù)制技術(shù)來提高數(shù)據(jù)可用性,保證數(shù)據(jù)的容錯性和提高容災(zāi)能力。云存儲技術(shù)的關(guān)鍵技術(shù)中就包含有副本管理技術(shù)和副本放置技術(shù)。這些技術(shù)能給系統(tǒng)帶來好處的同時,也帶來了一些負面的影響,比如多副本在系統(tǒng)中存儲勢必會增加存儲代價的開銷,副本維護也會消耗部分的系統(tǒng)資源。本文設(shè)計了一個數(shù)據(jù)復(fù)制方案并且提出了一個基于負載均衡的數(shù)據(jù)副本放置方法:(1)復(fù)制方案中包含對副本創(chuàng)建時機的判斷,副本數(shù)量的確定以及副本一致性維護。方案采用基于分塊計算校驗值的方式來驗證并找出需要同步的文件之間的差異數(shù)據(jù),在數(shù)據(jù)同步過程中只需要將兩個副本的差異數(shù)據(jù)同步即可。(2)針對副本放置問題,本文提出的副本放置算法在對整個系統(tǒng)中所有數(shù)據(jù)中心負載做均衡操作的基礎(chǔ)上,根據(jù)轉(zhuǎn)發(fā)服務(wù)請求信息的距離決定是否需要創(chuàng)建新的副本節(jié)點并選取合適的放置節(jié)點。選取合適的節(jié)點過程是對數(shù)據(jù)中心的各個性能參數(shù)綜合考評確定數(shù)據(jù)中心資本值,從而選取資本值最高的數(shù)據(jù)中心作為副本放置節(jié)點。仿真實驗結(jié)果表明,本文提出的副本放置方法是可行性的。最后,本文借助Hadoop平臺中分布式計算框架MapReduce以及分布式文件系統(tǒng)HDFS來設(shè)計了相關(guān)的業(yè)務(wù)場景,分別驗證了本文設(shè)計的復(fù)制方案以及數(shù)據(jù)副本放置方法,驗證結(jié)果表明,本文設(shè)計的復(fù)制方案和提出的副本放置方法都是可行的。
[Abstract]:With the development of cloud computing technology and cloud storage technology, the amount of data generated in the system is increasing explosively.In the face of massive data storage and processing, cloud computing technology and cloud storage technology has gradually become the mainstream of Internet technology data sharing and processing technology.In cloud storage systems, data replication technology is often used to improve data availability, ensure data fault tolerance and improve disaster tolerance.The key technologies of cloud storage include replica management and replica placement.These technologies can not only bring benefits to the system, but also bring some negative effects. For example, multi-copy storage in the system will inevitably increase the cost of storage, copy maintenance will also consume part of the system resources.In this paper, we design a data replication scheme and propose a data replica placement scheme based on load balancing, which includes the judgment of replica creation time, the determination of replica number and the maintenance of replica consistency.The scheme uses the method of calculating the check value based on block to verify and find out the difference data between the files that need to be synchronized. In the process of data synchronization, we only need to synchronize the difference data of two replicas.On the basis of balancing the load of all data centers in the whole system, the replica placement algorithm proposed in this paper determines whether a new replica node should be created and the appropriate placement node should be selected according to the distance of forwarding service request information.The process of selecting the appropriate node is to determine the capital value of the data center by synthetically evaluating the performance parameters of the data center, and then selecting the data center with the highest capital value as the replica to place the node.The simulation results show that the proposed replica placement method is feasible.Finally, this paper designs the related business scenarios with the help of the distributed computing framework MapReduce and the distributed file system HDFS in the Hadoop platform, and verifies the replication scheme and the data replica placement method designed in this paper, and the results show that,The replica scheme designed in this paper and the proposed replica placement method are feasible.
【學(xué)位授予單位】：南京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP333

【參考文獻】

相關(guān)期刊論文 前4條

1 傅穎勛;羅圣美;舒繼武;;安全云存儲系統(tǒng)與關(guān)鍵技術(shù)綜述[J];計算機研究與發(fā)展;2013年01期

2 郭東;杜勇;胡亮;;基于HDFS的云數(shù)據(jù)備份系統(tǒng)[J];吉林大學(xué)學(xué)報(理學(xué)版);2012年01期

3 熊潤群;羅軍舟;宋愛波;金嘉暉;;云計算環(huán)境下QoS偏好感知的副本選擇策略[J];通信學(xué)報;2011年07期

4 周可;王樺;李春花;;云存儲技術(shù)及其應(yīng)用[J];中興通訊技術(shù);2010年04期

，

本文編號：1741966