本文選題：配電網(wǎng) + 大數(shù)據(jù)　； 參考：《電力自動(dòng)化設(shè)備》2017年12期

【摘要】：針對(duì)配電自動(dòng)化中大量電力監(jiān)測(cè)數(shù)據(jù)的處理問題,提出了回避聚合操作的配電網(wǎng)監(jiān)測(cè)數(shù)據(jù)分布式Map壓縮-查詢新方法。通過將監(jiān)測(cè)數(shù)據(jù)分布式Map壓縮存儲(chǔ),利用HQL查詢引擎及壓縮接口將分布式Map壓縮應(yīng)用到連接查詢的混洗階段中,減小傳遞到查詢聚合端的數(shù)據(jù)量,提高壓縮數(shù)據(jù)的查詢速度,并推導(dǎo)了時(shí)效性的相關(guān)公式。以北京某動(dòng)車段10 kV電力遠(yuǎn)動(dòng)監(jiān)控系統(tǒng)的實(shí)測(cè)數(shù)據(jù)為例,搭建了四節(jié)點(diǎn)測(cè)試集群。壓縮導(dǎo)入對(duì)比測(cè)試表明,分布式Map壓縮速度快于分布式Reduce壓縮,分布式Map的Map_Deflate壓縮處理時(shí)間比分布式Reduce_Deflate減少了45.3%;壓縮-查詢測(cè)試表明,當(dāng)數(shù)據(jù)量為2×10~7記錄級(jí)時(shí),分布式Map的Map_LZO格式壓縮-查詢耗時(shí)大幅降低,比混洗階段不壓縮-查詢時(shí)減少了31.6%,驗(yàn)證了分布式Map壓縮對(duì)加速查詢的時(shí)效性。
[Abstract]:In order to deal with the problem of large amount of power monitoring data in distribution automation, a new distributed Map compression and query method for distribution network monitoring data is proposed. The distributed Map compression storage of monitoring data and the application of HQL query engine and compression interface to the mixed cleaning phase of the connection query are applied to reduce the distributed Map compression. It is transmitted to the amount of data at the aggregate end of the query, improves the query speed of the compressed data, and derives the relevant formulae of timeliness. Taking the measured data of the 10 kV electric power telecontrol monitoring system in a certain train section in Beijing as an example, the four node test cluster is set up. The compression import contrast test shows that the distributed Map compression speed is faster than the distributed Reduce compression. The Map_Deflate compression processing time of the distributed Map is reduced by 45.3% than that of distributed Reduce_Deflate; compression query testing shows that when the data amount is 2 x 10~7 record level, the Map_LZO format compression of distributed Map is greatly reduced, less than 31.6% when the query is not compressed to the query, which validates the distributed Map compression for accelerated query. It is timeliness.
【作者單位】： 華東交通大學(xué)電氣與自動(dòng)化工程學(xué)院;
【基金】：國家自然科學(xué)基金資助項(xiàng)目(51567008) 江西省杰出青年人才計(jì)劃項(xiàng)目(20162BCB23045) 江西省自然科學(xué)基金資助項(xiàng)目(20161BAB206156,20171BAB206044)~~
【分類號(hào)】：TM76
，

本文編號(hào)：2019801