本文選題：Hadoop　切入點：智能變電站　出處：《吉林大學》2017年碩士論文　論文類型：學位論文

【摘要】：伴隨我國智能變電站和相應的監(jiān)測體系不斷成熟和完善,產生的電力數(shù)據(jù)在數(shù)量方面大大提高,海量的數(shù)據(jù)存儲和復雜的數(shù)據(jù)類型使得傳統(tǒng)的數(shù)據(jù)管理模式很難滿足電力領域對于數(shù)據(jù)存儲和管理的要求。為使智能變電站高效、穩(wěn)定的工作,同時實現(xiàn)站內外各類數(shù)據(jù)的統(tǒng)一管理,需要構建智能變電站信息一體化平臺來提高站內各個部門交流與合作,并且基于大量監(jiān)控數(shù)據(jù)的存儲和管理來為領導層輔助決策。因此,構建新型的智能變電站數(shù)據(jù)管理系統(tǒng),以滿足企業(yè)在海量狀態(tài)信息存儲與查詢分析的需要具有重要的意義。同時,Hadoop、No SQL等大數(shù)據(jù)相關技術的快速發(fā)展,為支持海量數(shù)據(jù)存儲、快速檢索的智能變電站數(shù)據(jù)管理系統(tǒng)的研發(fā)奠定了堅實基礎。本文的具體研究內容如下:(1)針對智能變電站數(shù)據(jù)特點將數(shù)據(jù)整理為結構化、半結構化、非結構化三種類型,分別對不同類型的數(shù)據(jù)設計管理模式,研究變電站在線監(jiān)測數(shù)據(jù)的故障診斷框架和方案;(2)設計基于Hadoop的智能變電站數(shù)據(jù)管理系統(tǒng)總體框架、數(shù)據(jù)流轉過程、存儲和檢索功能,基于信息融合對變電站故障設備進行精確分析,基于關鍵詞提取設計變電站文獻關聯(lián)檢索;(3)在信息一體化平臺的基礎上開發(fā)基于Hadoop框架的智能變電站數(shù)據(jù)管理系統(tǒng),采用分布式文件系統(tǒng)(HDFS)和HBase數(shù)據(jù)庫對數(shù)據(jù)進行分布式存儲和管理,并行計算框架Map Reduce作為海量數(shù)據(jù)查詢分析的計算模式,利用Java語言實現(xiàn)B/S模式的智能變電站數(shù)據(jù)管理系統(tǒng);(4)使用真實的變電站運行監(jiān)測數(shù)據(jù)進行系統(tǒng)測試,分析系統(tǒng)的存儲性能、查詢性能、讀寫延遲對比、分布式索引對比�；贖adoop的智能變電站數(shù)據(jù)管理系統(tǒng)可以實現(xiàn)變電站各類信息的存儲和管理,包括變電站運行數(shù)據(jù)、在線監(jiān)測數(shù)據(jù)、設備管理信息、故障處理報告等。數(shù)據(jù)的錄入既可以手動輸入也支持批量導入,管理的數(shù)據(jù)類型包括結構化數(shù)據(jù)、半結構化數(shù)據(jù)和非結構化數(shù)據(jù),文檔管理中可以自動生成關鍵詞進行存儲,便于操作人員快速的檢索和讀取。利用Hadoop集群對不同規(guī)模數(shù)據(jù)集進行集群I/O性能測試、多維數(shù)據(jù)查詢與分析,測試結果表明該系統(tǒng)能夠合理的發(fā)揮出Hadoop在分布式存儲和計算方面的優(yōu)勢,完成對智能變電站各類業(yè)務信息的穩(wěn)定保存和快速檢索等管理功能,不僅極大的降低了運維成本,而且在系統(tǒng)穩(wěn)定性、擴展性等方面具有明顯優(yōu)勢,能夠滿足大規(guī)模智能變電站數(shù)據(jù)存儲查詢的需要,同時也為電力系統(tǒng)信息化的建設進行了有益探索。
[Abstract]:With the maturity and perfection of intelligent substation and corresponding monitoring system in our country, the quantity of electric power data produced has been greatly improved. The massive data storage and complex data types make it difficult for the traditional data management mode to meet the requirements of data storage and management in the electric power field. At the same time, to realize the unified management of all kinds of data inside and outside the station, it is necessary to construct the intelligent substation information integration platform to improve the communication and cooperation among the various departments in the station, and based on the storage and management of a large amount of monitoring data to assist the leadership decision-making. It is of great significance to construct a new intelligent substation data management system to meet the needs of mass state information storage and query analysis in enterprises. At the same time, with the rapid development of big data technology, such as Hadoop No SQL, to support mass data storage, The research and development of intelligent substation data management system with fast retrieval has laid a solid foundation. The specific research contents of this paper are as follows: 1) according to the characteristics of intelligent substation data, the data are arranged into three types: structured, semi-structured and unstructured. For different types of data design and management mode, this paper studies the fault diagnosis framework and scheme of substation on-line monitoring data. (2) Design the general framework, data flow process, storage and retrieval function of intelligent substation data management system based on Hadoop. Based on the accurate analysis of substation fault equipment based on information fusion and the design of substation literature association retrieval based on keyword extraction, an intelligent substation data management system based on Hadoop framework is developed on the basis of information integration platform. The distributed file system (HDFS) and the HBase database are used to store and manage the data. The parallel computing framework, Map Reduce, is used as the computing model for the query and analysis of massive data. The intelligent substation data management system based on B / S mode is implemented by Java language. Real substation operation monitoring data are used to test the system, and the storage performance, query performance, read and write delay of the system are analyzed and compared. Distributed index contrast. Intelligent substation data management system based on Hadoop can store and manage all kinds of substation information, including substation operation data, on-line monitoring data, equipment management information, etc. The data input can be manually input and can be imported in batches. The data types managed include structured data, semi-structured data and unstructured data, and can automatically generate keywords for storage in document management. Using Hadoop cluster to test the I / O performance of different size data sets, query and analyze multi-dimensional data. The test results show that the system can reasonably exert the advantages of Hadoop in distributed storage and computing, and complete the management functions of stable storage and fast retrieval of all kinds of service information in intelligent substation, which not only greatly reduces the cost of operation and maintenance, but also reduces the cost of operation and maintenance. Moreover, it has obvious advantages in system stability and expansibility, which can meet the needs of large scale intelligent substation data storage and query. At the same time, it also makes a beneficial exploration for the construction of power system informatization.
【學位授予單位】：吉林大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TM63;TM76;TP311.52

【參考文獻】

相關期刊論文 前10條

1 單長江;呂陸;王秋生;;變電站運維數(shù)據(jù)管理方法簡析[J];科技創(chuàng)新與應用;2016年32期

2 陳翔宇;羅懌;胡軍;傅守強;徐毅;張立斌;李紅建;段煉;;新一代智能變電站變電設備狀態(tài)評估大數(shù)據(jù)分析應用展望[J];電力信息與通信技術;2016年08期

3 蔡忠勇;;美國智能電網用戶域用例模型分析[J];電器與能效管理技術;2016年05期

4 肖燕;;新一代智能變電站信息流架構設計[J];中國電機工程學報;2016年05期

5 張守利;楊冬菊;韓燕波;;一種面向海量小文件的文件接收和存儲優(yōu)化方案[J];小型微型計算機系統(tǒng);2015年08期

6 孫艷華;王麗娜;;一種面向流數(shù)據(jù)的分布式實時存儲方法[J];電腦知識與技術;2015年19期

7 劉甜;盧磊;丁沿;;基于IEC61850的可視化系統(tǒng)配置器的設計與實現(xiàn)[J];電子設計工程;2015年08期

8 陸婷;房俊;喬彥克;;基于HBase的交通流數(shù)據(jù)實時存儲系統(tǒng)[J];計算機應用;2015年01期

9 程德保;;特高壓換流站運行數(shù)據(jù)多維度分析方法研究[J];機電信息;2014年27期

10 鄧亞寧;張偉;劉虹斌;;關于智能變電站一體化監(jiān)控系統(tǒng)設計的研究[J];通訊世界;2013年23期

相關碩士學位論文 前5條

1 王琰;智能變電站技術研究及其應用[D];山東大學;2016年

2 張海龍;基于IEC61850數(shù)字變電站通信系統(tǒng)實驗平臺的研究[D];青島科技大學;2016年

3 劉躍雷;基于精益化思想的變電站運行管理研究[D];華北電力大學;2013年

4 劉樹仁;基于Hadoop的電力設備狀態(tài)監(jiān)測數(shù)據(jù)存儲與訪問研究[D];華北電力大學;2013年

5 吳曉暉;無人值守變電站設備管理系統(tǒng)的設計與實現(xiàn)[D];電子科技大學;2012年

，

本文編號：1568823