移動(dòng)互聯(lián)網(wǎng)流量數(shù)據(jù)的高效處理與性能優(yōu)化
發(fā)布時(shí)間:2019-01-24 08:17
【摘要】:隨著科技的快速發(fā)展,網(wǎng)絡(luò)已經(jīng)成為了人們不可或缺的工具,網(wǎng)絡(luò)的應(yīng)用種類也越來越豐富。同時(shí),移動(dòng)通信技術(shù)的飛速發(fā)展,導(dǎo)致全球的移動(dòng)通信技術(shù)開始從2G向3G演進(jìn)。手機(jī)網(wǎng)民數(shù)量已超過傳統(tǒng)PC端的網(wǎng)民數(shù)量,而且以更快的速度不斷地增長。 本文首先介紹網(wǎng)絡(luò)流量監(jiān)控技術(shù)和移動(dòng)互聯(lián)網(wǎng)絡(luò)流量數(shù)據(jù)特征,接下來介紹了Google核心云計(jì)算技術(shù)以及該技術(shù)的一個(gè)完整的實(shí)現(xiàn)框架——Hadoop平臺(tái)。 為了更加高效地處理流量數(shù)據(jù),本文設(shè)計(jì)實(shí)現(xiàn)了基于Hadoop的分布式數(shù)據(jù)處理框架(Hadoop-Based Distributed Data Process System, HDPS),著重分析了HDPS數(shù)據(jù)分析模塊的架構(gòu)設(shè)計(jì)與實(shí)現(xiàn)方法。同時(shí),本文介紹了基于HDPS研發(fā)的幾個(gè)應(yīng)用系統(tǒng)——省網(wǎng)監(jiān)測(cè)系統(tǒng)和高性能分布式移動(dòng)網(wǎng)絡(luò)流量數(shù)據(jù)存儲(chǔ)查詢系統(tǒng),并著重探討高性能分布式移動(dòng)網(wǎng)絡(luò)流量數(shù)據(jù)存儲(chǔ)查詢系統(tǒng)的設(shè)計(jì)和實(shí)現(xiàn)。 最后,本文總結(jié)了分布式平臺(tái)性能優(yōu)化的經(jīng)驗(yàn)和方法,并介紹了這些性能優(yōu)化方式的應(yīng)用場(chǎng)景。
[Abstract]:With the rapid development of science and technology, the network has become an indispensable tool. At the same time, with the rapid development of mobile communication technology, the global mobile communication technology began to evolve from 2G to 3G. The number of mobile phone users has exceeded the number of traditional PC users, and growing at a faster pace. This paper first introduces the network traffic monitoring technology and the characteristics of mobile Internet traffic data, then introduces the core cloud computing technology of Google and a complete implementation framework of this technology, Hadoop platform. In order to deal with traffic data more efficiently, this paper designs and implements a distributed data processing framework based on Hadoop (Hadoop-Based Distributed Data Process System, HDPS), focuses on the analysis of HDPS data analysis module architecture design and implementation method). At the same time, this paper introduces several application systems based on HDPS, which are the provincial network monitoring system and the high performance distributed mobile network traffic data storage and query system. The design and implementation of high performance distributed mobile network traffic data storage and query system are discussed. Finally, this paper summarizes the experience and methods of performance optimization of distributed platform, and introduces the application scenarios of these performance optimization methods.
【學(xué)位授予單位】:北京郵電大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2014
【分類號(hào)】:TP393.06;TN929.5
本文編號(hào):2414289
[Abstract]:With the rapid development of science and technology, the network has become an indispensable tool. At the same time, with the rapid development of mobile communication technology, the global mobile communication technology began to evolve from 2G to 3G. The number of mobile phone users has exceeded the number of traditional PC users, and growing at a faster pace. This paper first introduces the network traffic monitoring technology and the characteristics of mobile Internet traffic data, then introduces the core cloud computing technology of Google and a complete implementation framework of this technology, Hadoop platform. In order to deal with traffic data more efficiently, this paper designs and implements a distributed data processing framework based on Hadoop (Hadoop-Based Distributed Data Process System, HDPS), focuses on the analysis of HDPS data analysis module architecture design and implementation method). At the same time, this paper introduces several application systems based on HDPS, which are the provincial network monitoring system and the high performance distributed mobile network traffic data storage and query system. The design and implementation of high performance distributed mobile network traffic data storage and query system are discussed. Finally, this paper summarizes the experience and methods of performance optimization of distributed platform, and introduces the application scenarios of these performance optimization methods.
【學(xué)位授予單位】:北京郵電大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2014
【分類號(hào)】:TP393.06;TN929.5
【參考文獻(xiàn)】
相關(guān)期刊論文 前2條
1 侯捷;;Java反射機(jī)制[J];程序員;2004年10期
2 唐興;;移動(dòng)通信技術(shù)的歷史及發(fā)展趨勢(shì)[J];江西通信科技;2008年02期
,本文編號(hào):2414289
本文鏈接:http://sikaile.net/guanlilunwen/ydhl/2414289.html
最近更新
教材專著