【摘要】：云存儲作為云計算的重要應用模式,近年來被廣泛應用于企業(yè)和個人,為個人和企業(yè)帶來了前所未有的便捷性。云存儲利用服務器集群技術、網(wǎng)格技術和分布式文件系統(tǒng)等技術,將不同的存儲設備通過網(wǎng)絡互聯(lián)來提供數(shù)據(jù)存儲方案。與傳統(tǒng)的存儲方案相比,云存儲具有擴展性強、性價比高、接入性好等優(yōu)點。然而,當企業(yè)或個人將數(shù)據(jù)完全托管給云存儲服務提供商時也面臨著服務可靠性、可用性、數(shù)據(jù)安全性、服務商鎖定等問題。本文采用的基于信息分散(IDA)的混合云存儲方案將多個公有云和私有云的混合,既能解決業(yè)界對于大容量存儲的需求,又能保證數(shù)據(jù)存儲和使用的可靠性和安全性。本文首先介紹了國內(nèi)外流行的數(shù)據(jù)存取技術,并總結了已有方案在面臨大數(shù)據(jù)存取以及數(shù)據(jù)安全性方面的優(yōu)勢和局限性,以此為背景對信息分散算法進行了研究,然后設計了基于信息分散算法的混合云存儲中間件架構。此方案利用RS糾刪碼將用戶終端上的數(shù)據(jù)進行分割、合并等處理,形成的文件元數(shù)據(jù)存儲在用戶的私有環(huán)境中,然后將處理后的數(shù)據(jù)存放在公有云存儲服務提供商中,實現(xiàn)了用戶文件的元數(shù)據(jù)與數(shù)據(jù)內(nèi)容分離,這樣便實現(xiàn)了文件存儲服務的去中心化,任何公有平臺均不存在用戶的元數(shù)據(jù)。這樣,既實現(xiàn)了文件存取的安全性、又發(fā)揮出云存儲的優(yōu)勢。數(shù)據(jù)在公有云上的存取面臨著云存儲服務提供商選擇的問題,涉及到網(wǎng)絡傳輸速率、數(shù)據(jù)存取費用、服務可用性等問題,因此本文還研究了數(shù)據(jù)在多個公有云上的存取調(diào)度策略,保證數(shù)據(jù)存取的性能、費用等因素的協(xié)調(diào),以實現(xiàn)混合云存儲的經(jīng)濟性。在多云存儲中間件架構設計的基礎上,本文還描述了系統(tǒng)的架構、功能、模塊設計,并利用多種開源工具完成系統(tǒng)的開發(fā)。最后我們將系統(tǒng)部署在HDFS、HBase組成的私有云上以及七牛云、金山云、阿里云等公有云存儲服務提供商上。最后本文對此系統(tǒng)進行了功能和性能測試,經(jīng)過測試本文所設計的混合云存儲架構達到設計預期,可透明、穩(wěn)定地滿足用戶數(shù)據(jù)在多個云存儲服務提供商上的正常存取。
[Abstract]:Cloud storage, as an important application mode of cloud computing, has been widely used in enterprises and individuals in recent years, which has brought unprecedented convenience to individuals and enterprises. Cloud storage uses server cluster technology, grid technology and distributed file system technology to provide different storage devices through network interconnection to provide data storage schemes. Compared with the traditional storage scheme, cloud storage has the advantages of strong expansibility, high cost performance and good access. However, when enterprises or individuals completely host data to cloud storage service providers, they also face the problems of service reliability, availability, data security, service provider locking and so on. A hybrid cloud storage scheme based on distributed information (IDA) is proposed in this paper, which combines public cloud and private cloud. It can not only meet the needs of mass storage, but also ensure the reliability and security of data storage and usage. This paper first introduces the popular data access technology at home and abroad, and summarizes the advantages and limitations of the existing schemes in the aspects of big data access and data security. Then a hybrid cloud storage middleware architecture based on information dispersion algorithm is designed. This scheme uses RS erasure code to divide and merge the data on the user terminal, and the file metadata is stored in the private environment of the user, and then the processed data is stored in the public cloud storage service provider. The metadata of the user file is separated from the data content so that the file storage service is decentralized and there is no user metadata on any public platform. In this way, it not only realizes the security of file access, but also gives play to the advantages of cloud storage. Data access on the public cloud faces the problem of cloud storage service provider selection, which involves network transmission rate, data access cost, service availability and so on. Therefore, this paper also studies the data access scheduling strategy on multiple public clouds to ensure the coordination of data access performance, cost and other factors in order to achieve the economy of hybrid cloud storage. On the basis of the architecture design of multi-cloud storage middleware, this paper also describes the architecture, function and module design of the system, and uses a variety of open source tools to complete the development of the system. Finally, we will deploy the system to the private cloud composed of HDFS,HBase and seven Niuyun, Jinshan cloud, Ali cloud and other public cloud storage service providers. Finally, the function and performance of the system are tested. The hybrid cloud storage architecture designed in this paper can meet the design expectations, and can meet the normal access of user data on multiple cloud storage service providers in a transparent and stable manner.
【學位授予單位】：電子科技大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TP333

【參考文獻】

相關期刊論文 前6條

1 齊嬋穎;李育超;房謹;吳海東;;基于云服務提供商的云存儲系統(tǒng)性能評測方法[J];中國科技信息;2015年22期

2 王健宗;諶炎俊;謝長生;;面向云存儲的I/O資源效用優(yōu)化調(diào)度算法研究[J];計算機研究與發(fā)展;2013年08期

3 程振東;欒鐘治;孟由;李亮淑;和榮;楊婷婷;錢德沛;管剛;陳偉;;云文件系統(tǒng)中糾刪碼技術的研究與實現(xiàn)[J];計算機科學與探索;2013年04期

4 傅穎勛;羅圣美;舒繼武;;安全云存儲系統(tǒng)與關鍵技術綜述[J];計算機研究與發(fā)展;2013年01期

5 余林琛;章巍;林強;許杰星;鐘貝;;RS糾刪碼在云存儲中的應用[J];微電子學與計算機;2011年08期

6 吳海佳;陳衛(wèi)衛(wèi);;基于RS糾刪碼的信息分散算法[J];計算機應用;2010年12期

相關博士學位論文 前2條

1 姚荻;對象存儲安全關鍵技術研究[D];華中科技大學;2011年

2 萬武南;分布式安全存儲系統(tǒng)糾刪碼技術的研究[D];中國科學院研究生院（成都計算機應用研究所）;2006年

，

本文編號：2331567