基于Hadoop交通信息并行處理云平臺的設(shè)計(jì)與實(shí)現(xiàn)
發(fā)布時間：2018-08-19 06:33
【摘要】：隨著社會的發(fā)展和城市化的加快,機(jī)動車的數(shù)量呈現(xiàn)爆炸式的增長。但有限的地理空間和緊缺的土地資源,使得人、車、路之間的交通矛盾日益突出。并且隨著計(jì)算機(jī)網(wǎng)絡(luò)和信息采集技術(shù)的發(fā)展,日常需要處理的交通數(shù)據(jù)也逐步增多。而傳統(tǒng)平臺在面對大數(shù)據(jù)問題時顯得捉襟見肘,這使得所面臨的交通問題越來越嚴(yán)重�？上驳氖�,目前出現(xiàn)了許多成熟的大數(shù)據(jù)處理技術(shù),為智能交通系統(tǒng)的發(fā)展帶來了新的思路。本文設(shè)計(jì)的主要出發(fā)點(diǎn)是通過將Hadoop、HBase與現(xiàn)有交通云平臺進(jìn)行整合,實(shí)現(xiàn)新一代智慧交通云平臺,從而增加平臺大數(shù)據(jù)處理的能力,改善現(xiàn)有的交通系統(tǒng)。本文研究的主要內(nèi)容有:1.Hadoop、HBase集群多節(jié)點(diǎn)部署:本文在基于v Sphere所構(gòu)建的多虛擬節(jié)點(diǎn)上搭建Hadoop與HBase集群,作為新一代交通云平臺的底層基礎(chǔ)。2.交通基礎(chǔ)服務(wù)的設(shè)計(jì)與實(shí)現(xiàn):本文給出了兩種交通服務(wù)的設(shè)計(jì)與實(shí)現(xiàn)方案,一種是針對原始交通數(shù)據(jù)所開發(fā)的數(shù)據(jù)中心統(tǒng)一化服務(wù),從而解決數(shù)據(jù)輸入的問題。另一種是為使已有云平臺獲得大數(shù)據(jù)處理能力而設(shè)計(jì)的并行計(jì)算和大數(shù)據(jù)存儲服務(wù)。3.交通應(yīng)用架構(gòu)設(shè)計(jì)與案例實(shí)現(xiàn):本文設(shè)計(jì)的交通應(yīng)用架構(gòu)體系體包括交通核心應(yīng)用和交通智慧應(yīng)用,其作用是驗(yàn)證新一代交通云平臺功能。其中交通核心應(yīng)用主要功能是基于Map Reduce框架對交通數(shù)據(jù)做計(jì)算與分析,而交通智慧應(yīng)用是將計(jì)算結(jié)果以可視化的角度展示給用戶。通過應(yīng)用的成功部署、運(yùn)行從而可以驗(yàn)證平臺整合方案的可行性、正確性。4.Hadoop、HBase集群與原有交通云平臺整合:本文在基于Socket通信方式的基礎(chǔ)上,實(shí)現(xiàn)了Hadoop、HBase集群與原有云平臺功能的整合,使得新一代智慧交通云平臺擁有大數(shù)據(jù)處理的能力。用戶通過整合后的平臺入口上傳并運(yùn)行應(yīng)用,從而獲取大數(shù)據(jù)計(jì)算和存儲能力。本文提出了通過融合Hadoop、HBase集群構(gòu)建交通信息并行處理云平臺的設(shè)計(jì)方案,從而解決交通領(lǐng)域大數(shù)據(jù)的難題。同時在此基礎(chǔ)上給出了交通應(yīng)用架構(gòu)和服務(wù)設(shè)計(jì)方案,為智能交通系統(tǒng)的發(fā)展做出了貢獻(xiàn)。
[Abstract]:With the development of society and the acceleration of urbanization, the number of motor vehicles is increasing explosively. However, limited geographical space and scarce land resources make traffic conflicts between people, cars and roads increasingly prominent. With the development of computer network and information collection technology, traffic data need to be processed gradually. The traditional platform is overstretched in the face of big data problem, which makes the traffic problem more and more serious. Fortunately, there are many mature big data processing technologies, which bring new ideas for the development of its. The main starting point of this design is to realize a new generation of intelligent transportation cloud platform by integrating Hadoop HBase with the existing transportation cloud platform, so as to increase the big data processing capacity of the platform and improve the existing transportation system. The main contents of this paper are as follows: 1. The multi-node deployment of Hadoop Sphere cluster: this paper builds Hadoop and HBase cluster on the multi-virtual nodes based on v Sphere, which is the base of the next generation traffic cloud platform. Design and implementation of basic traffic services: this paper presents two design and implementation schemes of traffic services. One is the unified data center service developed for raw traffic data, thus solving the problem of data input. The other is a parallel computing and big data storage service designed to enable existing cloud platforms to gain big data processing power. Traffic application architecture design and case implementation: the traffic application architecture system designed in this paper includes the traffic core application and the traffic intelligence application, whose function is to verify the function of the new generation transportation cloud platform. The main function of the traffic core application is to calculate and analyze the traffic data based on the Map Reduce framework, and the traffic intelligence application is to show the calculation results to the users in a visual way. Through the successful deployment of the application, the feasibility of the platform integration scheme can be verified by running. 4. The integration of Hadoop HBase cluster with the original traffic cloud platform: this paper is based on the Socket communication mode. The integration of Hadoop HBase cluster and the original cloud platform makes the new generation intelligent transportation cloud platform have the ability of big data processing. The user uploads and runs the application through the integrated platform entrance, thus obtains the big data computation and the storage ability. In this paper, we propose a design scheme of traffic information parallel processing cloud platform by integrating Hadoop HBase cluster, so as to solve the problem of big data in traffic field. At the same time, traffic application architecture and service design scheme are given, which contribute to the development of intelligent transportation system.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2015
【分類號】：U495
本文編號：2190945
[Abstract]:With the development of society and the acceleration of urbanization, the number of motor vehicles is increasing explosively. However, limited geographical space and scarce land resources make traffic conflicts between people, cars and roads increasingly prominent. With the development of computer network and information collection technology, traffic data need to be processed gradually. The traditional platform is overstretched in the face of big data problem, which makes the traffic problem more and more serious. Fortunately, there are many mature big data processing technologies, which bring new ideas for the development of its. The main starting point of this design is to realize a new generation of intelligent transportation cloud platform by integrating Hadoop HBase with the existing transportation cloud platform, so as to increase the big data processing capacity of the platform and improve the existing transportation system. The main contents of this paper are as follows: 1. The multi-node deployment of Hadoop Sphere cluster: this paper builds Hadoop and HBase cluster on the multi-virtual nodes based on v Sphere, which is the base of the next generation traffic cloud platform. Design and implementation of basic traffic services: this paper presents two design and implementation schemes of traffic services. One is the unified data center service developed for raw traffic data, thus solving the problem of data input. The other is a parallel computing and big data storage service designed to enable existing cloud platforms to gain big data processing power. Traffic application architecture design and case implementation: the traffic application architecture system designed in this paper includes the traffic core application and the traffic intelligence application, whose function is to verify the function of the new generation transportation cloud platform. The main function of the traffic core application is to calculate and analyze the traffic data based on the Map Reduce framework, and the traffic intelligence application is to show the calculation results to the users in a visual way. Through the successful deployment of the application, the feasibility of the platform integration scheme can be verified by running. 4. The integration of Hadoop HBase cluster with the original traffic cloud platform: this paper is based on the Socket communication mode. The integration of Hadoop HBase cluster and the original cloud platform makes the new generation intelligent transportation cloud platform have the ability of big data processing. The user uploads and runs the application through the integrated platform entrance, thus obtains the big data computation and the storage ability. In this paper, we propose a design scheme of traffic information parallel processing cloud platform by integrating Hadoop HBase cluster, so as to solve the problem of big data in traffic field. At the same time, traffic application architecture and service design scheme are given, which contribute to the development of intelligent transportation system.
【學(xué)位授予單位】：電子科技大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2015
【分類號】：U495
【引證文獻(xiàn)】
相關(guān)會議論文 前2條
1 周為鋼;楊良懷;龔衛(wèi)華;鄭申俊;沈貝倫;沈俊青;陳彬;陳彬彬;萬凱明;羅鋒;;大數(shù)據(jù)處理技術(shù)在智能交通中的應(yīng)用[A];第八屆中國智能交通年會優(yōu)秀論文集——智能交通與安全[C];2013年
2 張?zhí)?凌萍;;智慧交通大數(shù)據(jù)平臺設(shè)計(jì)開發(fā)及應(yīng)用[A];2014第九屆中國智能交通年會大會論文集[C];2014年
，本文編號：2190945
本文鏈接：http://sikaile.net/kejilunwen/daoluqiaoliang/2190945.html
教材專著
