分布式云存儲(chǔ)網(wǎng)關(guān)的設(shè)計(jì)與實(shí)現(xiàn)
發(fā)布時(shí)間：2019-06-11 22:57
【摘要】：隨著互聯(lián)網(wǎng)的普及和信息量的爆炸性增長，數(shù)據(jù)存儲(chǔ)花費(fèi)占企業(yè)總體開支的比重越來越大，企業(yè)正面臨著前所未有的存儲(chǔ)挑戰(zhàn)。近幾年出現(xiàn)的云存儲(chǔ)因具有高性價(jià)比，高可擴(kuò)展性，高可用性，高可靠性等優(yōu)點(diǎn)，正逐漸為市場所接受。盡管云存儲(chǔ)技術(shù)正處在高速發(fā)展中，且具有巨大的市場潛力，但仍存在訪問接口不統(tǒng)一、安全性不足、訪問速度低下等缺陷，這些缺陷已成為云存儲(chǔ)應(yīng)用的主要障礙。為解決這些問題，本文提出一種云存儲(chǔ)網(wǎng)關(guān)的設(shè)計(jì)方案，并基于該方案實(shí)現(xiàn)了原型系統(tǒng)。該系統(tǒng)不但能夠簡化云存儲(chǔ)的訪問方式，而且能夠成倍提高云存儲(chǔ)的訪問速度，并保護(hù)用戶數(shù)據(jù)的安全。 本文所設(shè)計(jì)的系統(tǒng)通過使用普通PC作為服務(wù)器在用戶本地搭建而成，以多臺(tái)普通PC構(gòu)成的分布式緩存系統(tǒng)作為快速的一級(jí)存儲(chǔ)設(shè)施，以云存儲(chǔ)作為慢速、大容量的二級(jí)存儲(chǔ)設(shè)施。系統(tǒng)在將分布式緩存中的文件換出至云存儲(chǔ)的過程中自動(dòng)進(jìn)行壓縮和加密操作，在將云存儲(chǔ)中的文件載入至緩存的過程中自動(dòng)進(jìn)行解壓和解密操作。同時(shí)系統(tǒng)為所有本地用戶提供全局統(tǒng)一的目錄空間和POSIX風(fēng)格的API。本文的具體工作如下： 1）提出了一種云存儲(chǔ)網(wǎng)關(guān)的設(shè)計(jì)方案，，并基于該方案實(shí)現(xiàn)了一個(gè)云存儲(chǔ)網(wǎng)關(guān)系統(tǒng)。 2）針對(duì)本系統(tǒng)的應(yīng)用場景就系統(tǒng)涉及到的關(guān)鍵技術(shù)如命名空間管理、地址映射、緩存替換和副本管理等進(jìn)行了詳細(xì)的討論，并提出了一種新的元數(shù)據(jù)組織存儲(chǔ)方案和改進(jìn)的LNC緩存替換算法。 3）給出了系統(tǒng)的整體設(shè)計(jì)方案和模塊劃分，并就系統(tǒng)中的主要流程和這些模塊之間的交互過程進(jìn)行了詳細(xì)的闡述。 4）就系統(tǒng)中關(guān)鍵的命名空間管理模塊和緩存空間管理模塊進(jìn)行了詳細(xì)的闡述，并給出了命名空間管理、地址映射、緩存替換和副本管理等關(guān)鍵技術(shù)和算法的詳細(xì)的設(shè)計(jì)與實(shí)現(xiàn)方案。 5）對(duì)原型系統(tǒng)進(jìn)行了詳細(xì)的測試，測試結(jié)果表明該系統(tǒng)在保證用戶數(shù)據(jù)安全的同時(shí)能夠有效的提高云存儲(chǔ)的訪問效率。
[Abstract]:With the popularity of the Internet and the explosive growth of information, data storage costs account for more and more of the total expenditure of enterprises, and enterprises are facing unprecedented storage challenges. In recent years, cloud storage is gradually accepted by the market because of its advantages of high performance-price ratio, high scalability, high availability, high reliability and so on. Although cloud storage technology is in the process of rapid development and has great market potential, there are still some defects, such as inconsistent access interface, insufficient security and low access speed, which have become the main obstacles to cloud storage applications. In order to solve these problems, this paper proposes a design scheme of cloud storage gateway, and implements a prototype system based on this scheme. The system can not only simplify the access mode of cloud storage, but also improve the access speed of cloud storage and protect the security of user data. The system designed in this paper is built locally by using ordinary PC as the server, the distributed cache system composed of several ordinary PC is used as the fast primary storage facility, and the cloud storage is used as the slow and large capacity secondary storage facility. In the process of replacing the files in the distributed cache to the cloud storage, the system automatically compresses and encrypts the files in the cloud storage, and automatically decompresses and decrypts the files in the cloud storage during the process of loading the files into the cache. At the same time, the system provides all local users with globally unified directory space and POSIX-style API.. The main work of this paper is as follows: 1) A design scheme of cloud storage gateway is proposed, and a cloud storage gateway system is implemented based on this scheme. 2) aiming at the application scenario of the system, the key technologies involved in the system, such as naming space management, address mapping, cache replacement and copy management, are discussed in detail, and a new metadata organization storage scheme and an improved LNC cache replacement algorithm are proposed. 3) the overall design scheme and module division of the system are given, and the main flow of the system and the interaction process between these modules are described in detail. 4) the key naming space management module and cache space management module in the system are described in detail, and the detailed design and implementation of key technologies and algorithms, such as naming space management, address mapping, cache replacement and replica management, are given. 5) the prototype system is tested in detail. The test results show that the system can effectively improve the access efficiency of cloud storage while ensuring the security of user data.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333
本文編號(hào)：2497522
[Abstract]:With the popularity of the Internet and the explosive growth of information, data storage costs account for more and more of the total expenditure of enterprises, and enterprises are facing unprecedented storage challenges. In recent years, cloud storage is gradually accepted by the market because of its advantages of high performance-price ratio, high scalability, high availability, high reliability and so on. Although cloud storage technology is in the process of rapid development and has great market potential, there are still some defects, such as inconsistent access interface, insufficient security and low access speed, which have become the main obstacles to cloud storage applications. In order to solve these problems, this paper proposes a design scheme of cloud storage gateway, and implements a prototype system based on this scheme. The system can not only simplify the access mode of cloud storage, but also improve the access speed of cloud storage and protect the security of user data. The system designed in this paper is built locally by using ordinary PC as the server, the distributed cache system composed of several ordinary PC is used as the fast primary storage facility, and the cloud storage is used as the slow and large capacity secondary storage facility. In the process of replacing the files in the distributed cache to the cloud storage, the system automatically compresses and encrypts the files in the cloud storage, and automatically decompresses and decrypts the files in the cloud storage during the process of loading the files into the cache. At the same time, the system provides all local users with globally unified directory space and POSIX-style API.. The main work of this paper is as follows: 1) A design scheme of cloud storage gateway is proposed, and a cloud storage gateway system is implemented based on this scheme. 2) aiming at the application scenario of the system, the key technologies involved in the system, such as naming space management, address mapping, cache replacement and copy management, are discussed in detail, and a new metadata organization storage scheme and an improved LNC cache replacement algorithm are proposed. 3) the overall design scheme and module division of the system are given, and the main flow of the system and the interaction process between these modules are described in detail. 4) the key naming space management module and cache space management module in the system are described in detail, and the detailed design and implementation of key technologies and algorithms, such as naming space management, address mapping, cache replacement and replica management, are given. 5) the prototype system is tested in detail. The test results show that the system can effectively improve the access efficiency of cloud storage while ensuring the security of user data.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333
【引證文獻(xiàn)】
相關(guān)期刊論文 前1條
1 趙鐵柱;鄧見光;;面向大規(guī)模數(shù)據(jù)備份的云存儲(chǔ)網(wǎng)關(guān)研究[J];計(jì)算機(jī)光盤軟件與應(yīng)用;2013年12期
本文編號(hào)：2497522
本文鏈接：http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2497522.html
最近更新
教材專著
