基于Hadoop的電信經(jīng)營數(shù)據(jù)分析系統(tǒng)的設(shè)計與實現(xiàn)
發(fā)布時間:2018-04-28 19:48
本文選題:Hadoop + 經(jīng)營數(shù)據(jù)分析 ; 參考:《天津大學(xué)》2016年碩士論文
【摘要】:人類已經(jīng)進(jìn)入了大數(shù)據(jù)時代,數(shù)據(jù)資產(chǎn)成為了企業(yè)的核心競爭力,如何圍繞電信企業(yè)的大數(shù)據(jù)資產(chǎn),構(gòu)建大數(shù)據(jù)生態(tài)系統(tǒng),以用戶體驗為導(dǎo)向,創(chuàng)新商業(yè)模式,成為了電信企業(yè)面臨的重要任務(wù)。面向電信企業(yè)的大數(shù)據(jù)分析平臺,其建設(shè)的原則是建設(shè)完善的、高性能的、開放的平臺;大數(shù)據(jù)能力平臺構(gòu)建的穩(wěn)定性是最重要的,重點需要關(guān)注部件的性能,以及對某項技術(shù)的更新?lián)Q代。同時提供大數(shù)據(jù)應(yīng)用能力開發(fā)的開發(fā)環(huán)境Develop Studio,使大數(shù)據(jù)合作伙伴能夠直接在這個平臺上開發(fā)應(yīng)用、發(fā)布應(yīng)用和運(yùn)行應(yīng)用。同時,大數(shù)據(jù)平臺的基本架構(gòu)實現(xiàn)全部云化;陔娦牌髽I(yè)對經(jīng)營分析大數(shù)據(jù)的需求,本文對基于Hadoop的電信經(jīng)營分析大數(shù)據(jù)分析平臺的架構(gòu)進(jìn)行了設(shè)計并對部分功能模塊進(jìn)行了實現(xiàn)。對基于Hadoop的電信運(yùn)營商大數(shù)據(jù)平臺進(jìn)行了設(shè)計與實現(xiàn),對此平臺的數(shù)據(jù)、技術(shù)架構(gòu)進(jìn)行了設(shè)計,對架構(gòu)中的信息整合、數(shù)據(jù)資產(chǎn)、能力開放等模塊進(jìn)行了設(shè)計;,對Hadoop集群在本系統(tǒng)中的應(yīng)用模式與應(yīng)用特點進(jìn)行了設(shè)計,對增強(qiáng)的Hadoop架構(gòu),以及Hadoop中的HDFS、MapReduce、HBase、MPP等增強(qiáng)功能進(jìn)行了在系統(tǒng)中的設(shè)計。對平臺的資源管理模塊的實現(xiàn)進(jìn)行了描述,對運(yùn)維管控模塊進(jìn)行了實現(xiàn),尤其對元數(shù)據(jù)的管理和數(shù)據(jù)安全進(jìn)行了詳細(xì)的實現(xiàn)。實際使用的結(jié)果表明,Hadoop架構(gòu)適合進(jìn)行電信經(jīng)營數(shù)據(jù)的分析統(tǒng)計。本文設(shè)計實現(xiàn)的大數(shù)據(jù)經(jīng)營分析平臺具有很強(qiáng)的實用性。
[Abstract]:Human beings have entered the era of big data, and data assets have become the core competitiveness of enterprises. Has become the telecommunication enterprise to face the important task. Big data's analytical platform for telecommunications enterprises is built on the principle of building a perfect, high performance and open platform. The stability of big data's ability platform is the most important, and the focus is on the performance of components. And the replacement of a technology. At the same time, it provides Develop Studio, a development environment for big data's application capability development, which enables big data partners to develop applications, release applications and run applications directly on this platform. At the same time, big data platform of the basic architecture to achieve all cloud. Based on the requirement of big data, this paper designs the architecture of the analysis platform of the telecom business analysis based on Hadoop and implements some functional modules. This paper designs and implements big data platform of telecom operator based on Hadoop, designs the data and technical framework of this platform, integrates information and data assets in the framework, The application mode and characteristics of Hadoop cluster in this system are designed. The enhanced Hadoop architecture and the enhanced functions such as HDFS MapReduceHBaseMMPP in Hadoop are designed in the system. The implementation of the resource management module of the platform is described, and the operation and maintenance management module is implemented, especially the metadata management and data security are implemented in detail. The practical results show that the Hadoop architecture is suitable for the analysis and statistics of telecom operation data. Big data management analysis platform designed and implemented in this paper has strong practicability.
【學(xué)位授予單位】:天津大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2016
【分類號】:F626;TP311.13
【參考文獻(xiàn)】
相關(guān)期刊論文 前8條
1 王珊;王會舉;覃雄派;周p,
本文編號:1816622
本文鏈接:http://sikaile.net/kejilunwen/ruanjiangongchenglunwen/1816622.html
最近更新
教材專著