發(fā)布時(shí)間：2018-11-14 15:29

【摘要】：云存儲(chǔ)作為云計(jì)算的重要應(yīng)用模式,近年來被廣泛應(yīng)用于企業(yè)和個(gè)人,為個(gè)人和企業(yè)帶來了前所未有的便捷性。云存儲(chǔ)利用服務(wù)器集群技術(shù)、網(wǎng)格技術(shù)和分布式文件系統(tǒng)等技術(shù),將不同的存儲(chǔ)設(shè)備通過網(wǎng)絡(luò)互聯(lián)來提供數(shù)據(jù)存儲(chǔ)方案。與傳統(tǒng)的存儲(chǔ)方案相比,云存儲(chǔ)具有擴(kuò)展性強(qiáng)、性價(jià)比高、接入性好等優(yōu)點(diǎn)。然而,當(dāng)企業(yè)或個(gè)人將數(shù)據(jù)完全托管給云存儲(chǔ)服務(wù)提供商時(shí)也面臨著服務(wù)可靠性、可用性、數(shù)據(jù)安全性、服務(wù)商鎖定等問題。本文采用的基于信息分散(IDA)的混合云存儲(chǔ)方案將多個(gè)公有云和私有云的混合,既能解決業(yè)界對(duì)于大容量存儲(chǔ)的需求,又能保證數(shù)據(jù)存儲(chǔ)和使用的可靠性和安全性。本文首先介紹了國內(nèi)外流行的數(shù)據(jù)存取技術(shù),并總結(jié)了已有方案在面臨大數(shù)據(jù)存取以及數(shù)據(jù)安全性方面的優(yōu)勢(shì)和局限性,以此為背景對(duì)信息分散算法進(jìn)行了研究,然后設(shè)計(jì)了基于信息分散算法的混合云存儲(chǔ)中間件架構(gòu)。此方案利用RS糾刪碼將用戶終端上的數(shù)據(jù)進(jìn)行分割、合并等處理,形成的文件元數(shù)據(jù)存儲(chǔ)在用戶的私有環(huán)境中,然后將處理后的數(shù)據(jù)存放在公有云存儲(chǔ)服務(wù)提供商中,實(shí)現(xiàn)了用戶文件的元數(shù)據(jù)與數(shù)據(jù)內(nèi)容分離,這樣便實(shí)現(xiàn)了文件存儲(chǔ)服務(wù)的去中心化,任何公有平臺(tái)均不存在用戶的元數(shù)據(jù)。這樣,既實(shí)現(xiàn)了文件存取的安全性、又發(fā)揮出云存儲(chǔ)的優(yōu)勢(shì)。數(shù)據(jù)在公有云上的存取面臨著云存儲(chǔ)服務(wù)提供商選擇的問題,涉及到網(wǎng)絡(luò)傳輸速率、數(shù)據(jù)存取費(fèi)用、服務(wù)可用性等問題,因此本文還研究了數(shù)據(jù)在多個(gè)公有云上的存取調(diào)度策略,保證數(shù)據(jù)存取的性能、費(fèi)用等因素的協(xié)調(diào),以實(shí)現(xiàn)混合云存儲(chǔ)的經(jīng)濟(jì)性。在多云存儲(chǔ)中間件架構(gòu)設(shè)計(jì)的基礎(chǔ)上,本文還描述了系統(tǒng)的架構(gòu)、功能、模塊設(shè)計(jì),并利用多種開源工具完成系統(tǒng)的開發(fā)。最后我們將系統(tǒng)部署在HDFS、HBase組成的私有云上以及七牛云、金山云、阿里云等公有云存儲(chǔ)服務(wù)提供商上。最后本文對(duì)此系統(tǒng)進(jìn)行了功能和性能測(cè)試,經(jīng)過測(cè)試本文所設(shè)計(jì)的混合云存儲(chǔ)架構(gòu)達(dá)到設(shè)計(jì)預(yù)期,可透明、穩(wěn)定地滿足用戶數(shù)據(jù)在多個(gè)云存儲(chǔ)服務(wù)提供商上的正常存取。
[Abstract]:Cloud storage, as an important application mode of cloud computing, has been widely used in enterprises and individuals in recent years, which has brought unprecedented convenience to individuals and enterprises. Cloud storage uses server cluster technology, grid technology and distributed file system technology to provide different storage devices through network interconnection to provide data storage schemes. Compared with the traditional storage scheme, cloud storage has the advantages of strong expansibility, high cost performance and good access. However, when enterprises or individuals completely host data to cloud storage service providers, they also face the problems of service reliability, availability, data security, service provider locking and so on. A hybrid cloud storage scheme based on distributed information (IDA) is proposed in this paper, which combines public cloud and private cloud. It can not only meet the needs of mass storage, but also ensure the reliability and security of data storage and usage. This paper first introduces the popular data access technology at home and abroad, and summarizes the advantages and limitations of the existing schemes in the aspects of big data access and data security. Then a hybrid cloud storage middleware architecture based on information dispersion algorithm is designed. This scheme uses RS erasure code to divide and merge the data on the user terminal, and the file metadata is stored in the private environment of the user, and then the processed data is stored in the public cloud storage service provider. The metadata of the user file is separated from the data content so that the file storage service is decentralized and there is no user metadata on any public platform. In this way, it not only realizes the security of file access, but also gives play to the advantages of cloud storage. Data access on the public cloud faces the problem of cloud storage service provider selection, which involves network transmission rate, data access cost, service availability and so on. Therefore, this paper also studies the data access scheduling strategy on multiple public clouds to ensure the coordination of data access performance, cost and other factors in order to achieve the economy of hybrid cloud storage. On the basis of the architecture design of multi-cloud storage middleware, this paper also describes the architecture, function and module design of the system, and uses a variety of open source tools to complete the development of the system. Finally, we will deploy the system to the private cloud composed of HDFS,HBase and seven Niuyun, Jinshan cloud, Ali cloud and other public cloud storage service providers. Finally, the function and performance of the system are tested. The hybrid cloud storage architecture designed in this paper can meet the design expectations, and can meet the normal access of user data on multiple cloud storage service providers in a transparent and stable manner.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前6條

1 齊嬋穎;李育超;房謹(jǐn);吳海東;;基于云服務(wù)提供商的云存儲(chǔ)系統(tǒng)性能評(píng)測(cè)方法[J];中國科技信息;2015年22期

2 王健宗;諶炎俊;謝長生;;面向云存儲(chǔ)的I/O資源效用優(yōu)化調(diào)度算法研究[J];計(jì)算機(jī)研究與發(fā)展;2013年08期

3 程振東;欒鐘治;孟由;李亮淑;和榮;楊婷婷;錢德沛;管剛;陳偉;;云文件系統(tǒng)中糾刪碼技術(shù)的研究與實(shí)現(xiàn)[J];計(jì)算機(jī)科學(xué)與探索;2013年04期

4 傅穎勛;羅圣美;舒繼武;;安全云存儲(chǔ)系統(tǒng)與關(guān)鍵技術(shù)綜述[J];計(jì)算機(jī)研究與發(fā)展;2013年01期

5 余林琛;章巍;林強(qiáng);許杰星;鐘貝;;RS糾刪碼在云存儲(chǔ)中的應(yīng)用[J];微電子學(xué)與計(jì)算機(jī);2011年08期

6 吳海佳;陳衛(wèi)衛(wèi);;基于RS糾刪碼的信息分散算法[J];計(jì)算機(jī)應(yīng)用;2010年12期

相關(guān)博士學(xué)位論文 前2條

1 姚荻;對(duì)象存儲(chǔ)安全關(guān)鍵技術(shù)研究[D];華中科技大學(xué);2011年

2 萬武南;分布式安全存儲(chǔ)系統(tǒng)糾刪碼技術(shù)的研究[D];中國科學(xué)院研究生院（成都計(jì)算機(jī)應(yīng)用研究所）;2006年

，

本文編號(hào)：2331567