發(fā)布時(shí)間：2018-06-12 18:25

  本文選題：交通流數(shù)據(jù) + HBase��； 參考：《北方工業(yè)大學(xué)》2017年碩士論文

【摘要】：隨著城市智能交通的快速發(fā)展、打車軟件和共享單車的盛行,交通數(shù)據(jù)呈現(xiàn)出指數(shù)式增長(zhǎng)。對(duì)交通數(shù)據(jù)進(jìn)行合理的分析可以預(yù)測(cè)出人們的出行習(xí)慣和熱門交通路線,為城市交通的管理提供幫助,也為相關(guān)互聯(lián)網(wǎng)公司創(chuàng)造營(yíng)收提供支持。HBase數(shù)據(jù)庫(kù)對(duì)大規(guī)模數(shù)據(jù)的存儲(chǔ)具有先天優(yōu)勢(shì),在交通領(lǐng)域的應(yīng)用非常廣泛。但是HBase只能在行鍵上構(gòu)建索引,無(wú)法直接構(gòu)建高效的多維索引和非行鍵索引,在交通數(shù)據(jù)的時(shí)空查詢上性能較差,并且無(wú)法實(shí)現(xiàn)快速的非行鍵查詢。針對(duì)這些問(wèn)題,需要為HBase構(gòu)建相應(yīng)的輔助索引。本文結(jié)合實(shí)時(shí)交通流數(shù)據(jù)的特點(diǎn),經(jīng)過(guò)大量的調(diào)研工作,對(duì)HBase時(shí)空索引和二級(jí)索引兩種輔助索引技術(shù)進(jìn)行了研究和設(shè)計(jì),實(shí)現(xiàn)了一個(gè)基于HBase輔助索引的查詢系統(tǒng)。主要研究?jī)?nèi)容如下:一、針對(duì)交通數(shù)據(jù)的時(shí)空三維特征,提升HBase對(duì)交通數(shù)據(jù)的時(shí)空查詢性能,本文通過(guò)Geohash降維的思想研究和設(shè)計(jì)了三種基于HBase的時(shí)空索引,并對(duì)其優(yōu)缺點(diǎn)和適用的場(chǎng)景作了分析。二、針對(duì)HBase非行鍵查詢性能低下的問(wèn)題,提高HBase對(duì)交通數(shù)據(jù)查詢支持的靈活度,本文通過(guò)倒排索引的思想研究和設(shè)計(jì)了兩種HBase二級(jí)索引,并作了相關(guān)分析。三、實(shí)現(xiàn)了一個(gè)基于HBase輔助索引的查詢系統(tǒng)。該系統(tǒng)實(shí)現(xiàn)了本文設(shè)計(jì)的兩種輔助索引中各自最優(yōu)的方案,還實(shí)現(xiàn)了 SQL解析、索引構(gòu)建、索引匹配、索引管理等功能,簡(jiǎn)化了用戶對(duì)HBase數(shù)據(jù)庫(kù)的查詢操作。四、最后通過(guò)實(shí)驗(yàn)驗(yàn)證了本文提出的索引方案能有效提升實(shí)時(shí)交通流數(shù)據(jù)的查詢性能,并且驗(yàn)證了索引管理的有效性。
[Abstract]:With the rapid development of urban intelligent transportation and the prevalence of ride-hailing software and shared bicycles, traffic data show exponential growth. Reasonable analysis of traffic data can predict people's travel habits and popular transportation routes, and provide help for urban traffic management. HBase also provides revenue support for related Internet companies. HBase database has an inherent advantage in large-scale data storage and is widely used in transportation. But HBASE can only build index on row key, can not directly build multi-dimensional index and non-line key index directly, and can not realize fast non-line key query because of its poor performance in spatio-temporal query of traffic data. To solve these problems, it is necessary to build corresponding auxiliary indexes for HBASE. According to the characteristics of real-time traffic flow data and through a lot of research work, this paper studies and designs two kinds of auxiliary index technology: HBase space-time index and second-level index, and realizes a query system based on HBAS-based auxiliary index. The main research contents are as follows: firstly, aiming at the spatial and temporal features of traffic data and improving the spatio-temporal query performance of HBase to traffic data, this paper studies and designs three space-time indexes based on HBase through the idea of reducing dimension of Geohash. Its advantages and disadvantages and applicable scenarios are analyzed. Secondly, in order to improve the flexibility of HBASE in traffic data query, two kinds of HBASE secondary indexes are designed and analyzed through the idea of inverted index, aiming at the low performance of HBASE non-line key query and improving the flexibility of HBASE to traffic data query. Thirdly, a query system based on HBASE aided index is implemented. The system realizes the optimal schemes of the two auxiliary indexes designed in this paper, and also realizes the functions of SQL parsing, index construction, index matching, index management and so on, which simplifies the query operation of the user to HBase database. Finally, the experimental results show that the proposed indexing scheme can effectively improve the query performance of real-time traffic flow data, and verify the effectiveness of index management.
【學(xué)位授予單位】：北方工業(yè)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：U495;TP311.13

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 李冬;房俊;;基于HBase的交通數(shù)據(jù)區(qū)域查詢方法[J];計(jì)算機(jī)與數(shù)字工程;2017年02期

2 房俊;李冬;郭會(huì)云;王嘉怡;;面向海量交通數(shù)據(jù)的HBase時(shí)空索引[J];計(jì)算機(jī)應(yīng)用;2017年02期

3 李德仁;馬軍;邵振峰;;論時(shí)空大數(shù)據(jù)及其應(yīng)用[J];衛(wèi)星應(yīng)用;2015年09期

4 葛微;羅圣美;周文輝;趙，

本文編號(hào)：2010651