基于Hadoop的電力設(shè)備狀態(tài)監(jiān)測數(shù)據(jù)存儲與訪問研究
發(fā)布時間:2018-07-04 19:02
本文選題:智能電網(wǎng) + 狀態(tài)監(jiān)測。 參考:《華北電力大學(xué)》2013年碩士論文
【摘要】:進入新世紀后,智能電網(wǎng)一直是電力行業(yè)研究和應(yīng)用的熱點,受到了世界各國的廣泛關(guān)注和推廣。隨著智能電網(wǎng)的逐步開展,其環(huán)境下的電力設(shè)備狀態(tài)監(jiān)測數(shù)據(jù)量將劇增,傳統(tǒng)的數(shù)據(jù)存儲和處理方法將遇到很大困難;如何安全高效地存儲這些數(shù)據(jù),并對其進行快速訪問已成為新的研究課題。Google關(guān)于云計算的論文發(fā)表之后,云計算平臺Hadoop異軍突起,具有海量存儲與運算、高擴展性和高可靠性等優(yōu)勢,,成為了解決上述電網(wǎng)問題的新策略。 本文首先詳細歸納和總結(jié)了電力設(shè)備狀態(tài)監(jiān)測系統(tǒng)的研究現(xiàn)狀,重點分析當前技術(shù)在數(shù)據(jù)存儲和處理方面所面臨的問題;隨后對云計算技術(shù)尤其是Hadoop平臺的研究和使用進行匯總。明確當前具體的應(yīng)用需求是海量狀態(tài)監(jiān)測數(shù)據(jù)高效存儲與快速處理;亟需解決的問題是不斷到來的高采樣率狀態(tài)監(jiān)測數(shù)據(jù)快速插入、以時序數(shù)據(jù)為主的多源異構(gòu)數(shù)據(jù)可靠性存儲,以及在海量狀態(tài)監(jiān)測數(shù)據(jù)上的快速查詢問題;根據(jù)Hadoop平臺的特點,確定將Hadoop平臺應(yīng)用到電力設(shè)備狀態(tài)監(jiān)測系統(tǒng),以實現(xiàn)海量狀態(tài)監(jiān)測數(shù)據(jù)的可靠存儲與高效查詢。 結(jié)合國內(nèi)電網(wǎng)公司的應(yīng)用需求和軟硬件實力,以及Hadoop平臺的相關(guān)技術(shù),針對智能電網(wǎng)對電力設(shè)備狀態(tài)監(jiān)測的高要求,提出了一種基于虛擬化技術(shù)的Hadoop數(shù)據(jù)存儲查詢模型,并從總體架構(gòu)設(shè)計、各個存儲子模塊設(shè)計等方面介紹了該模型的實現(xiàn)方法,解決了邏輯存儲結(jié)構(gòu)設(shè)計、查詢算法并行化等相關(guān)問題。 文中詳細地介紹了虛擬化技術(shù)下的Hadoop集群搭建,以及集群性能的基準測試,確定所搭建的集群具有海量數(shù)據(jù)存儲能力;對各個子模塊進行了性能測試,尤其是通過修改第三方軟件YCSB的內(nèi)核,對設(shè)計的HBase數(shù)據(jù)庫進行測試,證明了在電力設(shè)備狀態(tài)監(jiān)測各類應(yīng)用環(huán)境中相關(guān)設(shè)計的正確性和有效性。 本課題為下一代電力設(shè)備狀態(tài)監(jiān)測數(shù)據(jù)的存儲與查詢研究提供了新的思路;是采用Hadoop平臺服務(wù)于智能電網(wǎng)領(lǐng)域的一次有益嘗試。
[Abstract]:After entering the new century, smart grid has been the research and application hotspot of power industry, which has been widely concerned and popularized all over the world. With the gradual development of smart grid, the data of power equipment condition monitoring will increase dramatically in its environment, the traditional data storage and processing methods will meet great difficulties, how to store these data safely and efficiently, After Google's paper on cloud computing was published, Hadoop, a cloud computing platform, has many advantages, such as massive storage and computation, high scalability and high reliability. It has become a new strategy to solve the above problems. In this paper, the status quo of power equipment condition monitoring system is summarized in detail, and the problems in data storage and processing are analyzed. Then the research and use of cloud computing technology, especially Hadoop platform, are summarized. It is clear that the current specific application requirements are efficient storage and rapid processing of mass state monitoring data, and the urgent problem to be solved is the rapid insertion of continuous high sampling rate status monitoring data. According to the characteristics of Hadoop platform, it is determined to apply Hadoop platform to power equipment condition monitoring system. In order to realize the reliable storage and efficient query of massive state monitoring data. According to the application requirements, hardware and software strength of domestic grid companies, and the related technologies of Hadoop platform, a new Hadoop data storage query model based on virtualization technology is proposed to meet the high requirements of smart grid for power equipment state monitoring. The implementation method of the model is introduced from the aspects of the overall architecture design and the design of each storage sub-module, which solves the problems of logical storage structure design, query algorithm parallelization and so on. In this paper, the Hadoop cluster building under virtualization technology and the benchmark test of cluster performance are introduced in detail. It is determined that the cluster has the capacity of massive data storage, and the performance of each sub-module is tested. In particular, by modifying the core of the third-party software YCSB and testing the designed HBase database, the correctness and effectiveness of the related designs in various application environments of power equipment condition monitoring are proved. This paper provides a new idea for the storage and query of the state monitoring data of the next generation power equipment, and is a useful attempt to use Hadoop platform to serve the smart grid field.
【學(xué)位授予單位】:華北電力大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2013
【分類號】:TP333
【參考文獻】
相關(guān)期刊論文 前10條
1 王曉波;樊紀元;;電力調(diào)度中心統(tǒng)一數(shù)據(jù)平臺的設(shè)計[J];電力系統(tǒng)自動化;2006年22期
2 陳向宜;陳允平;李春艷;鄧長虹;;構(gòu)建大電網(wǎng)安全防御體系——歐洲大停電事故的分析及思考[J];電力系統(tǒng)自動化;2007年01期
3 林峰;胡牧;蔣元晨;倪斌;;電力調(diào)度綜合數(shù)據(jù)平臺體系結(jié)構(gòu)及相關(guān)技術(shù)[J];電力系統(tǒng)自動化;2007年01期
4 李先志;杜林;陳偉根;王有元;孫才新;李t熝
本文編號:2097055
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2097055.html
最近更新
教材專著