本文選題：云存儲(chǔ) + HDFS��； 參考：《電子科技大學(xué)》2012年碩士論文

【摘要】：現(xiàn)在是個(gè)信息爆炸的時(shí)代,每天都會(huì)涌現(xiàn)出各方面的信息,穿梭在日常生活中。根據(jù)IDC (Internet Data Center互聯(lián)網(wǎng)數(shù)據(jù)中心)的研究數(shù)據(jù)表明,未來數(shù)據(jù)的70%都是由個(gè)人用戶貢獻(xiàn)的。隨著互聯(lián)網(wǎng)的高速發(fā)展,人們對(duì)信息的要求越來越高。另一個(gè)方面,信息的擴(kuò)張速度很快,信息已經(jīng)成為了日常生活的一部分,如同水、電、氣一般�，F(xiàn)在難以統(tǒng)計(jì)當(dāng)前世界存在的信息有多少了,有統(tǒng)計(jì)結(jié)果表明,2006年的全球新增數(shù)據(jù)為0.18ZB,就相當(dāng)于18億TB數(shù)據(jù)了。這么多的數(shù)據(jù)如何存儲(chǔ),生活中信息怎樣分享如何快捷的訪問獲取,個(gè)人對(duì)數(shù)據(jù)的要求不再僅僅只是簡(jiǎn)單的復(fù)制和備份,個(gè)人云存儲(chǔ)的出現(xiàn),很好的解決了這個(gè)問題。 本文首先研究了個(gè)人云存儲(chǔ)服務(wù)系統(tǒng)的背景,國(guó)內(nèi)外的研究現(xiàn)狀和確定了研究目標(biāo)和內(nèi)容,接著詳細(xì)介紹了個(gè)人云存儲(chǔ)服務(wù)系統(tǒng)所使用到的主流技術(shù)以及特點(diǎn)。然后詳細(xì)敘述個(gè)人云存儲(chǔ)服務(wù)系統(tǒng)的設(shè)計(jì),先從需求分析得出系統(tǒng)的功能和設(shè)計(jì)目標(biāo),再得出系統(tǒng)的總體結(jié)構(gòu)分為客戶端和服務(wù)端,接著敘述系統(tǒng)的執(zhí)行流程和系統(tǒng)的設(shè)計(jì)特點(diǎn)。然后再根據(jù)文章系統(tǒng)設(shè)計(jì)的要求,詳細(xì)闡述系統(tǒng)客戶端中Web輔助檢查插件,PC客戶端和手機(jī)客戶端的代碼實(shí)現(xiàn)和原理,再闡述服務(wù)端中功能服務(wù)模塊,HDFS小文件處理引擎和HDFS文件接口的代碼實(shí)現(xiàn)和原理,全面敘述系統(tǒng)的實(shí)現(xiàn)過程和相關(guān)原理。最后搭建系統(tǒng)測(cè)試環(huán)境,針對(duì)系統(tǒng)做出相應(yīng)的性能測(cè)試和分析。 本文主要完成的工作有： 1、給出一套完整的個(gè)人云存儲(chǔ)服務(wù)系統(tǒng)解決方案。 2、實(shí)現(xiàn)客戶端的文件同步功能。 3、設(shè)計(jì)實(shí)現(xiàn)了HDFS的小文件處理引擎,以提高HDFS吞吐小文件的效率。 4、達(dá)到了個(gè)人云存儲(chǔ)服務(wù)系統(tǒng)的文件唯一性存儲(chǔ)目標(biāo)。 本文設(shè)計(jì)實(shí)現(xiàn)的個(gè)人云存儲(chǔ)服務(wù)系統(tǒng),能夠解決個(gè)人數(shù)據(jù)的海量存儲(chǔ),存儲(chǔ)的高可靠性,使用的便捷性,為個(gè)人提供可靠高效的存儲(chǔ)服務(wù)。
[Abstract]:Now is an era of information explosion, every day will emerge in all aspects of information, shuttle in daily life. According to the research data of the IDC (Internet Data Center Internet Data Center), 70% of the future data are contributed by individual users. With the rapid development of the Internet, the demand for information is getting higher and higher. On the other hand, information has been expanding quickly, information has become a part of daily life, like water, electricity, and gas. It is difficult to count how much information exists in the world now. Statistics show that the global new data in 2006 is 0.18ZB, which is equivalent to 1 billion 800 million TB data. So much of the data is stored and in life. How to share how fast access to access, personal data requirements are no longer just a simple copy and backup, the appearance of personal cloud storage, a good solution to this problem.
This paper first studies the background of the personal cloud storage service system, the research status at home and abroad, and the research goals and contents. Then the main technology and characteristics of the personal cloud storage service system are introduced in detail. Then the design of the personal cloud storage service system is described in detail, and the function of the system is first obtained from the requirement analysis. And then the overall structure of the system is divided into the client and the server, then the execution flow of the system and the design features of the system are described. Then, according to the requirements of the system design, the Web auxiliary check plug-in, the PC client and the mobile client are described in detail, and then the server is expounded. The implementation and principle of the medium function service module, the HDFS small file processing engine and the HDFS file interface, describe the implementation process and the related principles of the system. Finally, build the system test environment, and make corresponding performance testing and analysis for the system.
The main tasks of this article are as follows:
1, provide a complete solution for personal cloud storage service system.
2, the file synchronization function of the client is realized.
3, a small file processing engine of HDFS is designed and implemented to improve the efficiency of HDFS huff and puff.
4, achieves the file uniqueness storage objective of personal cloud storage service system.
The personal cloud storage service system designed and realized in this paper can solve the mass storage of personal data, the high reliability of the storage, the convenience of the use, and provide a reliable and efficient storage service for the individual.

【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 丁原,劉玉樹,朱天煥;集群服務(wù)器技術(shù)綜述[J];兵工自動(dòng)化;2000年03期

2 蔣文娟;降雪輝;;沙箱技術(shù)比較[J];才智;2011年05期

3 王京謙,萬蒞新;開源嵌入式數(shù)據(jù)庫BerkeleyDB和SQLite的比較[J];單片機(jī)與嵌入式系統(tǒng)應(yīng)用;2005年02期

4 潘建平,顧冠群,沈蘇彬;Web/HTTP協(xié)議性能分析和改進(jìn)的研究[J];計(jì)算機(jī)研究與發(fā)展;1999年01期

5 晏強(qiáng);張曉鋒;丁蕊;;云存儲(chǔ)技術(shù)研究[J];計(jì)算機(jī)與信息技術(shù);2011年12期

6 張裔智;趙毅;湯小斌;;MD5算法研究[J];計(jì)算機(jī)科學(xué);2008年07期

7 韋理;周悅芝;夏楠;;用于網(wǎng)絡(luò)存儲(chǔ)系統(tǒng)的存儲(chǔ)空間動(dòng)態(tài)分配方法[J];計(jì)算機(jī)工程;2008年05期

8 譚子軍;何連躍;;分布式存儲(chǔ)系統(tǒng)中用戶磁盤空間分配策略[J];計(jì)算機(jī)工程;2010年09期

9 任磊;張霖;張雅彬;陶飛;羅永亮;;云制造資源虛擬化研究[J];計(jì)算機(jī)集成制造系統(tǒng);2011年03期

10 肖愛華,汪詩林;J2EE通用數(shù)據(jù)訪問對(duì)象(DAO)模式設(shè)計(jì)與實(shí)現(xiàn)[J];計(jì)算機(jī)應(yīng)用與軟件;2005年09期

，

本文編號(hào)：1855614