【摘要】：隨著互聯(lián)網(wǎng)技術和分布式數(shù)據(jù)存儲的高速發(fā)展,企業(yè)對云平臺使用越來越普及。與此同時,人們對于自身存儲在云平臺的數(shù)據(jù)安全的關心程度也前所未有,對云平臺上存儲的數(shù)據(jù)安全有了更高的要求。Hadoop能夠讓用戶輕松架構和使用分布式平臺,然后通過該平臺對大量數(shù)據(jù)進行分布式處理。但是基于Hadoop的分布式數(shù)據(jù)存儲目前存在著很大的安全隱患,缺少對靜態(tài)數(shù)據(jù)的加密保障,在安全方面只關注了數(shù)據(jù)的驗證和備份等部分,并沒有注重數(shù)據(jù)本身的安全性,因此頻頻爆發(fā)安全問題。本文研究的主要內容就是將加密技術應用到Hadoop云平臺中,能夠實現(xiàn)對存儲在Hadoop云平臺的數(shù)據(jù)進行分布式的對稱加密和解密。首先,本論文在介紹了云計算和分布式數(shù)據(jù)存儲的國內外研究現(xiàn)狀和發(fā)展趨勢后,對Hadoop開源平臺的兩大關鍵技術:分布式文件系統(tǒng)HDFS(Hadoop Distributed Filesystem)和用于處理海量數(shù)據(jù)的編程模型MapReduce做了詳細的介紹。其次,通過對現(xiàn)有加密算法的對比,分析傳統(tǒng)分布式數(shù)據(jù)存儲和Hadoop分布式數(shù)據(jù)存儲存在的問題,本文結合Hadoop分布式云計算框架中的的MapReduce模型,總結得出了基于Hadoop的分布式對稱加密數(shù)據(jù)存儲技術,并進行了簡要的分析。然后,從整體上對數(shù)據(jù)的分布式加密和解密各個模塊進行了設計,并詳細介紹了用MapReduce實現(xiàn)對稱加密AES(Advanced Encryption Standard)算法過程,特別是著重介紹和設計了能夠實現(xiàn)該算法的Map函數(shù)和Reduce函數(shù)。最后,在實驗室內搭建Hadoop集群,并且通過該云平臺,來實現(xiàn)加密和解密過程,并對分布式對稱加密算法進行功能測試、擴展性測試和效率測試,驗證整個流程。通過比較測試數(shù)據(jù)給出仿真性能分析,提出優(yōu)化問題,并對工作進行了總結和展望。
[Abstract]:With the rapid development of Internet technology and distributed data storage, the use of cloud platform is becoming more and more popular. At the same time, people pay more attention to the security of data stored on cloud platform than ever before. Hadoop can make it easy for users to construct and use distributed platform. Then, a large number of data are distributed through the platform. However, the distributed data storage based on Hadoop has great security hidden danger at present, it lacks the encryption guarantee of static data, pays attention only to the verification and backup of data in the security aspect, and does not pay attention to the security of the data itself. As a result, security issues frequently erupt. The main content of this paper is to apply encryption technology to Hadoop cloud platform, which can realize distributed symmetric encryption and decryption of data stored in Hadoop cloud platform. First of all, this paper introduces the research status and development trend of cloud computing and distributed data storage at home and abroad. This paper introduces two key technologies of Hadoop open source platform: distributed file system (HDFS (Hadoop Distributed Filesystem) and programming model (MapReduce) which is used to deal with massive data. Secondly, by comparing the existing encryption algorithms, this paper analyzes the problems existing in traditional distributed data storage and Hadoop distributed data storage, and combines the MapReduce model of Hadoop distributed cloud computing framework. The distributed symmetric encryption data storage technology based on Hadoop is summarized and analyzed briefly. Then, the distributed encryption and decryption modules of data are designed, and the process of using MapReduce to realize symmetric encryption AES (Advanced Encryption Standard) algorithm is introduced in detail. Especially, the Map function and Reduce function which can realize the algorithm are introduced and designed. Finally, the Hadoop cluster is built in the laboratory, and the encryption and decryption process is realized through the cloud platform. The distributed symmetric encryption algorithm is tested by function, extensibility test and efficiency test, and the whole process is verified. The simulation performance analysis is given by comparing the test data, the optimization problem is put forward, and the work is summarized and prospected.
【學位授予單位】：西安科技大學
【學位級別】：碩士
【學位授予年份】：2015
【分類號】：TP309.7;TP333

【相似文獻】

相關期刊論文 前10條

1 劉慧;徐振中;;一種改進的加密型WAP協(xié)議[J];計算機應用與軟件;2006年07期

2 周慶;何校棟;胡月;;用簡單物理模型構建通用對稱加密系統(tǒng)[J];物理學報;2011年09期

3 徐江峰;趙峰;;基于雙密鑰的對稱加密方案[J];計算機工程;2008年08期

4 陳鴻星;周媛蘭;;基于不對稱加密的網(wǎng)絡信息安全對策研究[J];網(wǎng)絡安全技術與應用;2012年06期

5 王燦;秦志光;;一種基于對稱加密和隱寫術的反取證方法[J];南京郵電大學學報(自然科學版);2009年03期

6 徐秀花;黃炯威;;電子批簽系統(tǒng)的設計與實現(xiàn)[J];北京印刷學院學報;2006年05期

7 陳芳芳;ASP.NET中的加密技術——對稱加密[J];信息技術;2005年07期

8 黃益栓;盧建朱;;一種基于身份的認證加密新方案[J];計算機工程;2007年07期

9 張衛(wèi)濤;鄧月華;王欽;;對稱加密數(shù)據(jù)隨機性定量研究[J];宇航計測技術;2011年03期

10 劉浪;周新衛(wèi);;基于DES對稱加密體制的探討[J];科技廣場;2012年10期

相關碩士學位論文 前3條

1 靳盼;基于Hadoop的分布式對稱加密數(shù)據(jù)存儲的分析與研究[D];西安科技大學;2015年

2 賈蕤銘;基于Android系統(tǒng)的動態(tài)密鑰管理方案的研究及實現(xiàn)[D];西北師范大學;2014年

3 蔡照鵬;DD-S-CPK-IC在改進SSLVPN記錄層的應用[D];遼寧工程技術大學;2010年

，

本文編號：2147604