基于Hadoop的CDN-P2P系統(tǒng)中內(nèi)容預(yù)測(cè)機(jī)制研究與實(shí)現(xiàn)
本文選題:CDN-P2P + 需求預(yù)測(cè) ; 參考:《北京郵電大學(xué)》2013年碩士論文
【摘要】:近十幾年來(lái),隨著互聯(lián)網(wǎng)的飛速發(fā)展,網(wǎng)絡(luò)信息量和用戶數(shù)急劇增長(zhǎng),網(wǎng)絡(luò)共享和傳輸?shù)膬?nèi)容也由簡(jiǎn)單的文字、圖片擴(kuò)展到音頻、視頻等結(jié)構(gòu)復(fù)雜、形式多樣的多媒體。為了高效進(jìn)行網(wǎng)絡(luò)內(nèi)容分發(fā),緩解網(wǎng)絡(luò)擁塞,提升用戶體驗(yàn),CDN和P2P技術(shù)作為網(wǎng)絡(luò)內(nèi)容分發(fā)的主要技術(shù),在眾多領(lǐng)域被廣泛應(yīng)用?紤]到CDN和P2P技術(shù)在提供服務(wù)時(shí)與生俱有的互補(bǔ)性,CDN-P2P融合技術(shù)也成為新的研究熱點(diǎn)。 網(wǎng)絡(luò)規(guī)模的不斷擴(kuò)大,共享資源信息的激增,給CDN-P2P網(wǎng)絡(luò)中節(jié)點(diǎn)文件共享以及邊緣服務(wù)器文件服務(wù)的提供,帶來(lái)了諸多問(wèn)題。主要表現(xiàn)為:對(duì)邊緣服務(wù)器存儲(chǔ)負(fù)載能力以及P2P節(jié)點(diǎn)文件請(qǐng)求響應(yīng)時(shí)間的要求。CDN-P2P網(wǎng)絡(luò)需要服務(wù)的節(jié)點(diǎn)數(shù)和提供的文件數(shù)量不斷增大,需要在邊緣服務(wù)器和內(nèi)容源服務(wù)器之間,或者邊緣服務(wù)器之間頻繁傳送文件,不僅增加節(jié)點(diǎn)文件請(qǐng)求的響應(yīng)時(shí)間,而且消耗帶寬資源。同時(shí),節(jié)點(diǎn)用戶也需要花費(fèi)大量時(shí)間在海量資源信息中尋找自己需要的內(nèi)容。 改進(jìn)CDN-P2P網(wǎng)絡(luò)中邊緣服務(wù)器的內(nèi)容緩存放置策略,快速響應(yīng)節(jié)點(diǎn)文件請(qǐng)求,提高節(jié)點(diǎn)用戶在海量信息中發(fā)現(xiàn)所需求內(nèi)容以及共享內(nèi)容的效率,是未來(lái)CDN-P2P技術(shù)重要的發(fā)展方向。本文針對(duì)上述問(wèn)題,通過(guò)分析CDN-P2P網(wǎng)絡(luò)的特點(diǎn),特別是節(jié)點(diǎn)用戶能動(dòng)性參與的影響因素,融合智能推薦、搜索引擎技術(shù),對(duì)基于Hadoop的CDN-P2P原型系統(tǒng)進(jìn)行了改進(jìn)。 本文的研究?jī)?nèi)容包括以下幾個(gè)方面: (1)通過(guò)分析共享內(nèi)容的類型屬性和節(jié)點(diǎn)需求的聯(lián)系,計(jì)算用戶偏好因子,然后結(jié)合節(jié)點(diǎn)用戶歷史評(píng)分相似性和偏好因子,改進(jìn)協(xié)同過(guò)濾方法的預(yù)測(cè)函數(shù),對(duì)節(jié)點(diǎn)用戶需求預(yù)測(cè)模型進(jìn)行分析研究。 (2)研究傳統(tǒng)CDN技術(shù),并結(jié)合現(xiàn)有CDN-P2P系統(tǒng)中節(jié)點(diǎn)子網(wǎng)組織的特性以及節(jié)點(diǎn)之間的相似性,對(duì)目前系統(tǒng)中內(nèi)容預(yù)存策略進(jìn)行重新設(shè)計(jì)。 (3)鑒于節(jié)點(diǎn)用戶對(duì)內(nèi)容共享的需要,為了方便用戶查找相關(guān)信息,基于Solr設(shè)計(jì)實(shí)現(xiàn)了一個(gè)共享內(nèi)容搜索子系統(tǒng),用戶可以通過(guò)輸入關(guān)鍵詞來(lái)查找資源信息。 (4)在CDN-P2P原型系統(tǒng)中對(duì)上面提出的節(jié)點(diǎn)用戶需求預(yù)測(cè)模型和邊緣服務(wù)器內(nèi)容預(yù)存策略予以實(shí)現(xiàn)。
[Abstract]:In the past decade, with the rapid development of the Internet, the amount of network information and the number of users have increased dramatically. The content of network sharing and transmission has also expanded from simple text, pictures to audio, video and other complex structures, various forms of multimedia. In order to efficiently distribute network content, alleviate network congestion and enhance user experience, CDN and P2P technology are widely used in many fields as the main technology of network content distribution. Considering that CDN and P2P technologies are complementary to each other in providing services, CDN-P2P convergence technology has also become a new research hotspot. With the continuous expansion of network scale and the proliferation of shared resource information, many problems have been brought to the sharing of node files in CDN-P2P network and the provision of edge server file services. It is shown that the number of nodes and the number of files provided by the CDN-P2P network need to be increased, which is between the edge server and the content source server, and the demand for the storage load of the edge server and the response time of the file request of the P2P node. Or the frequent transfer of files between edge servers not only increases the response time of node file requests, but also consumes bandwidth resources. At the same time, node users also need to spend a lot of time searching for their own content in the massive resource information. It is an important development direction of CDN-P2P technology in the future to improve the content cache policy of edge server in CDN-P2P network, respond to the request of node file quickly, and improve the efficiency of node users finding the required content and sharing content in the massive information. In order to solve the above problems, this paper analyzes the characteristics of CDN-P2P network, especially the influence factors of node user's active participation, integrates intelligent recommendation and search engine technology, and improves the CDN-P2P prototype system based on Hadoop. The research content of this paper includes the following aspects: 1) by analyzing the relationship between the type attributes of shared content and node demand, the user preference factor is calculated, and then the prediction function of collaborative filtering method is improved by combining the similarity of node users' history score and preference factor. The node user demand prediction model is analyzed and studied. (2) the traditional CDN technology is studied, and combining with the characteristics of node subnet organization and the similarity between nodes in the existing CDN-P2P system, the content storage strategy in the current system is redesigned. In view of the needs of node users for content sharing, in order to facilitate users to find relevant information, a shared content search subsystem is designed and implemented based on Solr. Users can search resource information by entering keywords. 4) implement the node user demand prediction model and the edge server content storage strategy in the CDN-P2P prototype system.
【學(xué)位授予單位】:北京郵電大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2013
【分類號(hào)】:TP393.02
【參考文獻(xiàn)】
相關(guān)期刊論文 前10條
1 方娟;梁文燦;;一種基于協(xié)同過(guò)濾的網(wǎng)格門戶推薦模型[J];電子與信息學(xué)報(bào);2010年07期
2 徐風(fēng)苓;孟祥武;王立才;;基于移動(dòng)用戶上下文相似度的協(xié)同過(guò)濾推薦算法[J];電子與信息學(xué)報(bào);2011年11期
3 黃武漢;孟祥武;王立才;;移動(dòng)通信網(wǎng)中基于用戶社會(huì)化關(guān)系挖掘的協(xié)同過(guò)濾算法[J];電子與信息學(xué)報(bào);2011年12期
4 宗瑜;金萍;陳恩紅;李紅;劉仁金;;面向Weblog的模糊協(xié)同聚類算法[J];電子與信息學(xué)報(bào);2012年03期
5 蔣海;李軍;李忠誠(chéng);;混合內(nèi)容分發(fā)網(wǎng)絡(luò)及其性能分析模型[J];計(jì)算機(jī)學(xué)報(bào);2009年03期
6 楊傳棟,余鎮(zhèn)危,王行剛;結(jié)合CDN與P2P技術(shù)的混合流媒體系統(tǒng)研究[J];計(jì)算機(jī)應(yīng)用;2005年09期
7 曾春,邢春曉,周立柱;個(gè)性化服務(wù)技術(shù)綜述[J];軟件學(xué)報(bào);2002年10期
8 許海玲;吳瀟;李曉東;閻保平;;互聯(lián)網(wǎng)推薦系統(tǒng)比較研究[J];軟件學(xué)報(bào);2009年02期
9 黃永生;孟祥武;張玉潔;;基于社會(huì)網(wǎng)絡(luò)特征的P2P內(nèi)容定位策略[J];軟件學(xué)報(bào);2010年10期
10 陳勇;孫世新;周益民;李軍;馮永政;;基于P2P的CDN新型網(wǎng)絡(luò)及緩存替換算法[J];微電子學(xué)與計(jì)算機(jī);2008年09期
相關(guān)博士學(xué)位論文 前1條
1 黃永生;基于用戶社會(huì)屬性的點(diǎn)對(duì)點(diǎn)內(nèi)容分發(fā)網(wǎng)絡(luò)模型研究[D];北京郵電大學(xué);2010年
相關(guān)碩士學(xué)位論文 前3條
1 連蒴;基于Web搜索引擎系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[D];復(fù)旦大學(xué);2011年
2 韓立寶;基于P2POverCDN和RTSP的流媒體代理服務(wù)器的設(shè)計(jì)與實(shí)現(xiàn)[D];西安電子科技大學(xué);2008年
3 朱濤;基于P2P的內(nèi)容分發(fā)網(wǎng)絡(luò)的系統(tǒng)結(jié)構(gòu)資源搜索與路由算法研究[D];電子科技大學(xué);2008年
,本文編號(hào):1788294
本文鏈接:http://sikaile.net/kejilunwen/sousuoyinqinglunwen/1788294.html