本文選題：DRE + 冗余模式　； 參考：《北京郵電大學(xué)》2014年碩士論文

【摘要】：隨著互聯(lián)網(wǎng)的不斷發(fā)展和普及,互聯(lián)網(wǎng)所承載的數(shù)據(jù)流量增長迅速,互聯(lián)網(wǎng)服務(wù)所需的網(wǎng)絡(luò)帶寬也在不斷增加。作為互聯(lián)網(wǎng)的基礎(chǔ)支撐服務(wù),CDN網(wǎng)絡(luò)承載了全球大部分的互聯(lián)網(wǎng)流量,數(shù)據(jù)冗余消除(DRE)技術(shù)在廣域網(wǎng)加速和單網(wǎng)站冗余消除方面已經(jīng)得到了一定程度的應(yīng)用,但針對CDN網(wǎng)絡(luò)所傳輸數(shù)據(jù)的數(shù)據(jù)冗余消除技術(shù)目前還沒有被實際應(yīng)用。通過分析CDN網(wǎng)絡(luò)數(shù)據(jù)傳輸中的冗余模式特性,來指導(dǎo)DRE技術(shù)在CDN網(wǎng)絡(luò)中的實際應(yīng)用,以提高CDN網(wǎng)絡(luò)中的數(shù)據(jù)傳輸效率,是目前亟待解決的問題。 本文在實驗室項目“數(shù)據(jù)冗余消除技術(shù)在CDN網(wǎng)絡(luò)流量壓縮中的應(yīng)用研究”的基礎(chǔ)上,完成了針對CDN網(wǎng)絡(luò)流量的冗余模式分析系統(tǒng)各個模塊的設(shè)計與實現(xiàn)。整個系統(tǒng)分為數(shù)據(jù)預(yù)處理模塊、數(shù)據(jù)基礎(chǔ)分析模塊、冗余模式分析模塊和結(jié)果分析與展現(xiàn)模塊,輸入的網(wǎng)絡(luò)流量數(shù)據(jù)經(jīng)過預(yù)處理模塊被處理成按時間段劃分的數(shù)據(jù)文件,通過數(shù)據(jù)基礎(chǔ)分析模塊提取網(wǎng)絡(luò)數(shù)據(jù)包中的各種特性,并決定用以區(qū)分不同客戶端流量的字段,然后經(jīng)過冗余模式分析模塊完成對流量數(shù)據(jù)冗余特性的分析,得出各項技術(shù)參數(shù)和時間周期等對于DRE壓縮效果的影響,最后經(jīng)過分析與展現(xiàn)模塊呈現(xiàn)出分析結(jié)果。 論文首先分析了CDN網(wǎng)絡(luò)流量中數(shù)據(jù)冗余消除的特點,對現(xiàn)有冗余消除的應(yīng)用場景進行了研究。其次對DRE技術(shù)的緩存字典與替換算法、字典的冷熱模式、動態(tài)靜態(tài)模式等核心部分進行了研究和總結(jié),對DRE技術(shù)相關(guān)的指紋生成算法中使用的拉賓卡普算法,MAXP算法進行了概括和總結(jié)。在此基礎(chǔ)上,作者基于對于DRE技術(shù)的理解,改進了現(xiàn)有冗余模式分析技術(shù)方案的缺點,設(shè)計并實現(xiàn)了網(wǎng)絡(luò)數(shù)據(jù)冗余模式分析系統(tǒng)。本文從系統(tǒng)設(shè)計思想、技術(shù)路線、系統(tǒng)流程和系統(tǒng)模塊構(gòu)成等方面對冗余模式分析系統(tǒng)進行全面的介紹。最后本文介紹了借助網(wǎng)絡(luò)數(shù)據(jù)冗余模式分析系統(tǒng)對示例網(wǎng)絡(luò)數(shù)據(jù)進行分析后得出的詳細(xì)分析結(jié)論與成果。 論文基于對CDN網(wǎng)絡(luò)數(shù)據(jù)冗余模式分析的需求,將DRE等算法和對HTTP網(wǎng)絡(luò)數(shù)據(jù)內(nèi)容類型等信息的識別方法在數(shù)據(jù)冗余分析中進行了應(yīng)用和工程實現(xiàn),進而開發(fā)完成了一個對網(wǎng)絡(luò)數(shù)據(jù)冗余模式進行分析的系統(tǒng)。該系統(tǒng)實現(xiàn)了對大量網(wǎng)絡(luò)數(shù)據(jù)冗余模式分析的流程,可以用在對特定數(shù)據(jù)冗余模式分析的研究領(lǐng)域,具有一定的工程應(yīng)用價值。
[Abstract]:With the continuous development of the Internet and the popularity of the Internet data traffic load increases rapidly, the required Internet service network bandwidth is increasing. The support service as the foundation of the Internet, the CDN network carries most of the global Internet traffic, data redundancy elimination (DRE) technique in Wan acceleration and single site redundancy elimination has been applied to a certain extent, but for the CDN network data transmission data redundancy elimination technology has not yet been applied. Through the analysis of redundancy mode characteristics of CDN network data transmission in practical application, to guide the DRE technology in the CDN network, to improve the efficiency of data transmission in CDN network, is the most important to solve the problem.
Based on the laboratory project "research and application of technology in the CDN network traffic data compression redundancy elimination, the completion of the redundancy mode of CDN network traffic analysis system design and implementation of each module. The whole system is divided into data preprocessing module, data analysis module, module and the redundancy analysis and mode analysis show the input module, the network traffic data after preprocessing module is processed into divided by time data file extraction module and network data packet in various characteristics through the analysis of the data base, and decided to use the field to distinguish different client traffic, and then through the redundancy mode analysis module to complete analysis of the traffic data redundancy, the technical parameters and cycle time for DRE compression effect, finally through the analysis and display module shows the results of the analysis.
This paper first analyzes the characteristics of data redundancy elimination CDN in network traffic, the application scene of existing redundancy elimination are studied. Secondly the DRE technology and dictionary cache replacement algorithm, and model dictionary, dynamic static model of core part is studied and summarized, the Rabin Karp algorithm using fingerprint generation algorithm related to DRE technology, MAXP algorithm is analyzed and summarized. On this basis, the author for the understanding of DRE technology based on improved redundancy mode analysis method has its disadvantages, the design and implementation of network data redundancy mode analysis system. The system design thought, technical route, system process and system module etc. a comprehensive introduction of redundancy mode analysis system. Finally this paper introduces the analysis of redundant data model system for example network data analysis Detailed analysis conclusions and results obtained.
The analysis of CDN network data redundancy mode based on the needs of the DRE algorithm and the HTTP network data content type information recognition method in data redundancy analysis of application and engineering, and has developed a network of data redundancy mode for system analysis. The system realizes the analysis of a large number of redundant data model of the process, can be used in the research field of analysis of the specific data redundancy mode, it has certain engineering application value.

【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2014
【分類號】：TP393.06

【相似文獻】

相關(guān)期刊論文 前10條

1 梅海青;;兩種數(shù)據(jù)冗余方案的淺析[J];可編程控制器與工廠自動化;2010年07期

2 韓少軍;;基于數(shù)據(jù)冗余的無損信息隱藏技術(shù)研究[J];電腦知識與技術(shù);2011年14期

3 何潤潤;;基于糾刪碼的數(shù)據(jù)冗余策略研究[J];機電技術(shù);2010年05期

4 周游;劉鵬;楊盛祥;薛志強;文艾;;基于私有云的數(shù)據(jù)冗余技術(shù)研究[J];電腦知識與技術(shù);2011年01期

5 彭宇,車文剛,楊健;CBR系統(tǒng)中實例庫數(shù)據(jù)冗余的解決[J];大連民族學(xué)院學(xué)報;2005年01期

6 李琳琳;王慶超;姚超;李釗;;云存儲中的數(shù)據(jù)冗余策略研究[J];無線電工程;2013年09期

7 宋曉蕓,樂嘉錦;消除數(shù)據(jù)冗余的XML模式設(shè)計方法[J];計算機工程;2004年17期

8 袁小華;VFP中減少數(shù)據(jù)冗余的一種實現(xiàn)方法[J];江蘇廣播電視大學(xué)學(xué)報;2004年03期

9 陳貴海;吳帆;李宏興;邱彤慶;;基于DHT的P2P系統(tǒng)中高可用數(shù)據(jù)冗余機制[J];計算機學(xué)報;2008年10期

10 鄭健;霍國輝;張朋程;王欣欣;;Aprior算法降低數(shù)據(jù)冗余的可行性研究[J];現(xiàn)代商業(yè);2011年03期

相關(guān)碩士學(xué)位論文 前1條

1 郭冰;網(wǎng)絡(luò)數(shù)據(jù)冗余模式分析系統(tǒng)研究與實現(xiàn)[D];北京郵電大學(xué);2014年

，

本文編號：1745996