基于Storm的實時用戶日志管理系統(tǒng)
發(fā)布時間:2018-11-03 16:08
【摘要】:研究并開發(fā)了具有實時響應(yīng)的大數(shù)據(jù)用戶日志管理分析平臺。采用Storm流式計算框架,完成用戶日志分析的實時處理平臺架構(gòu);采用Elastic Search作為實時搜索引擎,完成實時響應(yīng)處理;使用Flume、Kafka技術(shù)完成海量日志采集、聚合和傳輸?shù)裙δ。以某城市監(jiān)獄管理系統(tǒng)的用戶日志信息為實驗數(shù)據(jù),系統(tǒng)取得了良好的實驗效果。為同時處理海量數(shù)據(jù)和實時響應(yīng)用戶請求的系統(tǒng)提供了可行性解決方案。
[Abstract]:This paper studies and develops big data user log management and analysis platform with real-time response. Storm flow computing framework is used to complete the real-time processing platform architecture of user log analysis; Elastic Search is used as a real-time search engine to complete real-time response processing; Flume,Kafka technology is used to complete mass log collection aggregation and transmission functions. Taking the user log information of a city prison management system as experimental data, the system has achieved good experimental results. It provides a feasible solution for the system which simultaneously processes the massive data and responds to the user's request in real time.
【作者單位】: 湖北工業(yè)大學(xué)計算機學(xué)院;湖北泰信科技信息發(fā)展有限責(zé)任公司;
【基金】:2013年國家大學(xué)生創(chuàng)新項目(201410500010)
【分類號】:TP311.13
本文編號:2308272
[Abstract]:This paper studies and develops big data user log management and analysis platform with real-time response. Storm flow computing framework is used to complete the real-time processing platform architecture of user log analysis; Elastic Search is used as a real-time search engine to complete real-time response processing; Flume,Kafka technology is used to complete mass log collection aggregation and transmission functions. Taking the user log information of a city prison management system as experimental data, the system has achieved good experimental results. It provides a feasible solution for the system which simultaneously processes the massive data and responds to the user's request in real time.
【作者單位】: 湖北工業(yè)大學(xué)計算機學(xué)院;湖北泰信科技信息發(fā)展有限責(zé)任公司;
【基金】:2013年國家大學(xué)生創(chuàng)新項目(201410500010)
【分類號】:TP311.13
【相似文獻(xiàn)】
相關(guān)期刊論文 前2條
1 熊忠陽;向海燕;張玉芳;;結(jié)合用戶日志的局部上下文分析方法[J];計算機工程與應(yīng)用;2012年12期
2 ;[J];;年期
相關(guān)會議論文 前1條
1 吳京慧;余珊珊;王明文;;基于用戶日志聚類的查詢擴展模型[A];第三屆全國信息檢索與內(nèi)容安全學(xué)術(shù)會議論文集[C];2007年
相關(guān)碩士學(xué)位論文 前1條
1 薛士俊;英語學(xué)習(xí)的需求研究與產(chǎn)品原型設(shè)計[D];大連海事大學(xué);2008年
,本文編號:2308272
本文鏈接:http://sikaile.net/kejilunwen/sousuoyinqinglunwen/2308272.html
最近更新
教材專著