本文選題：Hadoop集群 + 監(jiān)控�。� 參考：《北京郵電大學(xué)》2016年碩士論文

【摘要】：近年來,隨著信息化時代的到來,數(shù)據(jù)呈現(xiàn)爆炸式的增長趨勢,普通的大型計算機(jī)已經(jīng)無法承擔(dān)計算海量數(shù)據(jù)的任務(wù),各大互聯(lián)網(wǎng)公司紛紛采用大規(guī)模的Hadoop集群來完成數(shù)據(jù)的存儲和分析。隨著Hadoop集群的規(guī)模越來越大,確保大規(guī)模集群的穩(wěn)定運行成為重點關(guān)注的問題。為了實時監(jiān)控集群的運行狀況、在集群出現(xiàn)問題的時候可以及時通知管理者,需要開發(fā)一套部署在集群上的監(jiān)控和告警工具,此工具能夠提供一個可視化前端界面,并且支持自動化部署和隨時擴(kuò)展監(jiān)控告警指標(biāo),能夠讓管理者有效的維護(hù)集群,保證集群的正常工作。論文首先介紹了本課題的研究背景和研究意義,對國內(nèi)外已有的集群監(jiān)控告警軟件做了調(diào)查和介紹,闡明本文將要研究的監(jiān)控告警工具的特點和應(yīng)用價值。其次,介紹了承載監(jiān)控告警工具的分布式集群的基礎(chǔ)知識,以及設(shè)計監(jiān)控和管理系統(tǒng)時所考慮到的三個關(guān)鍵問題,并初步介紹了對應(yīng)的解決方案和設(shè)計思想。然后詳細(xì)描述了監(jiān)控告警平臺的整體架構(gòu),展示了監(jiān)控管理平臺的運行流程,介紹了平臺的各個組成模塊。重點分析了系統(tǒng)的兩個主要組成模塊:采集模塊和告警模塊,對采集模塊進(jìn)行了描述,從采集模塊的結(jié)構(gòu)圖說起,詳細(xì)介紹了采集模塊的工作機(jī)制;接著介紹了告警模塊的結(jié)構(gòu)和工作流程,包括告警的監(jiān)控指標(biāo)等。之后從數(shù)據(jù)庫中提取采集到的性能指標(biāo)數(shù)據(jù),并對其作圖分析集群的運行狀況。最后,對已完成的研究做了總結(jié),提出系統(tǒng)中不足的地方,并對未來需要完善的方面做了展望。
[Abstract]:In recent years, with the arrival of the information age, the data show an explosive growth trend, ordinary mainframe computers can no longer undertake the task of computing massive data.Major Internet companies have adopted large-scale Hadoop clusters to complete data storage and analysis.With the increasing scale of Hadoop cluster, it becomes a key issue to ensure the stable operation of large cluster.In order to monitor the running status of the cluster in real time, the manager can be informed in time when there is a problem in the cluster. It is necessary to develop a set of monitoring and warning tools deployed on the cluster, which can provide a visual front-end interface.It also supports automatic deployment and extended monitoring and alarm indicators at any time, which enables managers to maintain the cluster effectively and ensure the normal operation of the cluster.Firstly, this paper introduces the research background and significance of this subject, investigates and introduces the existing cluster monitoring and warning software at home and abroad, and clarifies the characteristics and application value of the monitoring and warning tools to be studied in this paper.Secondly, the basic knowledge of distributed cluster with monitoring and warning tools is introduced, and the three key problems considered in the design of monitoring and management system are introduced, and the corresponding solutions and design ideas are also introduced.Then the whole structure of the monitoring alarm platform is described in detail, the running flow of the monitoring and management platform is shown, and each component module of the platform is introduced.The two main modules of the system are analyzed emphatically: the collection module and the alarm module. The collection module is described, and the working mechanism of the collection module is introduced in detail from the structure diagram of the collection module.Then, the structure and work flow of alarm module are introduced, including alarm monitoring index and so on.After that, the collected performance index data are extracted from the database, and the running status of the cluster is analyzed by drawing the data.Finally, the paper summarizes the completed research, puts forward the deficiencies of the system, and looks forward to the future needs to be improved.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2016
【分類號】：TP277;TP311.52

【參考文獻(xiàn)】

相關(guān)期刊論文 前3條

1 徐建;張琨;劉鳳玉;;基于Linux的計算系統(tǒng)性能監(jiān)控[J];南京理工大學(xué)學(xué)報(自然科學(xué)版);2007年05期

2 童端,董小社,李紀(jì)云,吳維剛;基于Web的遠(yuǎn)程集群監(jiān)控系統(tǒng)的設(shè)計與實現(xiàn)[J];計算機(jī)工程與應(yīng)用;2003年35期

3 查禮,徐志偉,林國璋,劉玉樹,劉東華,李偉;基于LDAP的網(wǎng)格監(jiān)控系統(tǒng)[J];計算機(jī)研究與發(fā)展;2002年08期

，

本文編號：1748205