本文選題：分布式系統(tǒng) + 可擴展性�。� 參考：《華中科技大學(xué)》2012年碩士論文

【摘要】：在當(dāng)今互聯(lián)網(wǎng)環(huán)境下，圖片已經(jīng)成為大多網(wǎng)站展示內(nèi)容的一種主要手段，用戶也常通過照片來分享自己的生活和心情。而隨著互聯(lián)網(wǎng)的高速發(fā)展，，傳統(tǒng)的圖片存儲服務(wù)正面臨著數(shù)據(jù)規(guī)模高速增長和數(shù)據(jù)訪問高并發(fā)這兩方面的挑戰(zhàn)。這就需要圖片存儲系統(tǒng)具有良好的可擴展性和高性能。此外，如今的互聯(lián)網(wǎng)應(yīng)用越來越多樣化，很難有一種通用的辦法適用于所有的系統(tǒng)，我們需要針對系統(tǒng)的應(yīng)用特征來設(shè)計相應(yīng)的解決方案。 以研究各大互聯(lián)網(wǎng)公司的圖片存儲系統(tǒng)為基礎(chǔ)，結(jié)合論文分享社會化網(wǎng)絡(luò)的應(yīng)用特點，提出一種日志型的基于哈希樹和鍵值對（key-value）接口的存儲模型，同時借鑒已有的解決系統(tǒng)可擴展性和可靠性的分布式架構(gòu)設(shè)計理念，對傳統(tǒng)的圖片存儲系統(tǒng)進行改進。使用日志型的key-value模型，將圖片數(shù)據(jù)只增不減的寫入大文件中，減少了文件數(shù)量，簡化了操作系統(tǒng)的管理，同時使用哈希樹結(jié)構(gòu)，組織圖片在大文件中的索引信息，實現(xiàn)圖片的快速讀��；采用分布式的架構(gòu)設(shè)計，實現(xiàn)系統(tǒng)的可擴展性和可靠性；結(jié)合論文分享的特點，利用圖片之間的相關(guān)性，進一步提高讀取性能；采用了epoll網(wǎng)絡(luò)模型和領(lǐng)導(dǎo)者-跟隨者（leader-follower）線程模型，有效地提升了系統(tǒng)處理高并發(fā)請求的能力。然后根據(jù)提出的解決方案實現(xiàn)了一個針對論文分享的圖片存儲系統(tǒng)，并詳細介紹了系統(tǒng)的架構(gòu)、核心模塊以及相應(yīng)實現(xiàn)。 最后對論文分享系統(tǒng)進行了性能測試，分別對采用日志型的key-value模型、采用哈希樹組織索引信息、結(jié)合論文圖片相關(guān)性以及使用epoll和leader-follower模型等方案進行了相應(yīng)的測試，并與沒有采用這些方案的系統(tǒng)進行對比，測試結(jié)果表明新系統(tǒng)的性能有了很大提升，驗證了設(shè)計的針對論文分享的圖片存儲系統(tǒng)具有良好的性能。
[Abstract]:In today ' s Internet environment , images have become a major means of presenting content in most websites , and users often share their lives and mood through photos . With the rapid development of the Internet , traditional image storage services are facing the challenges of high data size and high data access . This requires a picture storage system with good scalability and high performance . In addition , today ' s Internet applications are becoming more diverse , and it is difficult to have a general approach to all systems , and we need to design the corresponding solutions for the application features of the system .

This paper presents a kind of log - based storage model based on hash tree and key - value interface based on the research of the image storage system of each big internet company , and proposes a kind of log - based storage model based on hash tree and key - value interface .
the distributed architecture design is adopted to realize the expandability and the reliability of the system ;
According to the characteristics of the sharing of the paper , the correlation between the pictures is utilized to further improve the reading performance ;
The epoll network model and leader - follower thread model are adopted to effectively improve the ability of the system to process high concurrency requests . Then a picture storage system for the paper sharing is realized according to the proposed solution , and the architecture , core module and corresponding implementation of the system are introduced in detail .

Finally , the performance test of the paper - sharing system is carried out , the key - value model of the log type is adopted , the index information of the hash tree is adopted , the correlation of the paper pictures is combined and compared with the system without the schemes , the test results show that the performance of the new system is greatly improved , and the design is verified to have good performance for the picture storage system shared by the paper .
【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2012
【分類號】：TP333

【參考文獻】

相關(guān)期刊論文 前3條

1 劉江;;開放、標準化、低成本是云計算的大勢所趨[J];程序員;2010年07期

2 王偉軍;孫晶;;Web2.0的研究與應(yīng)用綜述[J];情報科學(xué);2007年12期

3 田磊;;基于MogileFS建設(shè)廉價的電子檔案管理系統(tǒng)[J];現(xiàn)代計算機(專業(yè)版);2009年11期

本文編號：1917507