本文關鍵詞：分布式存儲中的資源索引技術研究　出處：《浙江大學》2013年碩士論文　論文類型：學位論文

  更多相關文章： 分布式存儲 倒排索引 信譽 負載均衡 資源索引 可擴展性

【摘要】：互聯(lián)網(wǎng)的快速發(fā)展導致數(shù)據(jù)量的不斷膨脹,單一節(jié)點的存儲容量難以滿足海量數(shù)據(jù)存儲的要求,用戶對容量巨大、安全、高效、可靠的分布式存儲系統(tǒng)的需求也越來越大。傳統(tǒng)的分布式存儲系統(tǒng)通常部署在穩(wěn)定可靠的節(jié)點上,難以有效利用P2P網(wǎng)絡中大量的存儲空間和計算資源。如何利用這些空閑的存儲和計算資源以構建大容量、高可用的存儲服務平臺是當前分布式存儲領域的研究熱點。 本文分析了P2P網(wǎng)絡的特點以及當前分布式存儲系統(tǒng)在資源檢索方面的特點,提出并實現(xiàn)了一個基于信譽的倒排索引框架ROIN;根據(jù)DHT結構的特點,設計了一個基于分組和信譽的負載均衡分布式存儲與資源索引框架LBGR。 ROIN框架通過雙層DHT網(wǎng)絡進行資源檢索,實現(xiàn)了關鍵字模糊搜索,克服了傳統(tǒng)DHT結構的不足；針對P2P網(wǎng)絡中節(jié)點動態(tài)性強的特點,建立了節(jié)點信譽模型并計算節(jié)點的信譽值,在此基礎上選取高信譽值的節(jié)點作為索引節(jié)點,從而避免了將索引信息存儲在不可靠節(jié)點上,提高了系統(tǒng)的可靠性。通過搜索覆蓋率、搜索延遲、索引節(jié)點負載和網(wǎng)絡擾動等方面的實驗,以及一系列與GlusterFS、 Pastry、PCIR的對比實驗,證明了ROIN能夠在P2P網(wǎng)絡上建立一個健壯、有效的資源索引框架。 由于ROIN是分布式的資源索引框架,同樣存在數(shù)據(jù)一致性等普遍存在于分布式資源索引系統(tǒng)中的問題,本文提出了一種新型的資源索引框架LBGR。LBGR采用了分組和信譽相結合的資源管理策略,實現(xiàn)了基于DHT結構的資源索引技術。通過信譽系統(tǒng)的評估,LBGR框架選擇高信譽值的節(jié)點作為超級節(jié)點并對惡意節(jié)點進行有效遏制；通過基于虛擬節(jié)點的負載均衡策略,解決了DHT系統(tǒng)中普遍存在的負載均衡問題。模擬實驗驗證了所提出的負載均衡算法的有效性,其結果可與集中式負載均衡算法相比擬。通過與GlusterFS的比較分析,LBGR顯示了在應對P2P網(wǎng)絡節(jié)點動態(tài)性方面的優(yōu)勢。 上述兩種不同的資源索引框架均能運行在P2P網(wǎng)絡上,各具優(yōu)勢,并通過實驗證明能提供可靠高效的服務,具有實際應用價值。
[Abstract]:The rapid development of the Internet leads to the continuous expansion of the data quantity , the storage capacity of a single node is difficult to meet the requirements of the mass data storage , and the requirement of the user to the distributed storage system with large capacity , safety , high efficiency and reliability is more and more large . Traditional distributed storage systems are usually deployed on a stable and reliable node , so that a large amount of storage space and computing resources in the P2P network are difficult to effectively utilize . This paper analyzes the characteristics of P2P network and the characteristics of current distributed storage system in resource retrieval , proposes and implements a reputation - based inverted index framework ROIN , designs a load balance distributed storage and resource index framework LBGR based on packet and reputation according to the characteristics of DHT structure . In order to overcome the disadvantages of traditional DHT structure , a node reputation model is established and the node ' s reputation value is calculated , and a series of experiments with GlusterFS , Pastry and PCIR prove that ROIN can set up a robust and effective resource index framework on P2P network . Because ROIN is a distributed resource index framework , there is also a problem that data consistency exists in distributed resource indexing system . In this paper , a new resource index framework LBGR.LBGR is proposed . A new resource index technology based on DHT is presented . Based on the evaluation of reputation system , the LBGR framework selects the node with high reputation value as the super node and effectively restrains the malicious node . The simulation experiment verifies the effectiveness of the proposed load balancing algorithm . The results can be compared with the centralized load balancing algorithm . By comparison with GlusterFS , LBGR shows the advantages of the P2P network node dynamics . the two different resource index frames can be operated on the P2P network , the advantages are advantageous , and a reliable and efficient service can be provided through experiments to have practical application value .

【學位授予單位】：浙江大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TP333

【參考文獻】

相關期刊論文 前3條

1 賈兆慶;薛廣濤;唐新懷;張鵬翥;尤晉元;;非結構化P2P中的一種信任機制[J];計算機研究與發(fā)展;2010年04期

2 楊磊;黃浩;李仁發(fā);李肯立;;一種基于分組管理的混合式P2P存儲系統(tǒng)[J];計算機科學;2010年01期

3 劉玉枚;楊壽保;陳萬明;郭磊濤;韋冬;;P2P系統(tǒng)中基于信譽感知的超級節(jié)點選擇算法研究[J];中國科學院研究生院學報;2008年02期

，

本文編號：1421959