一種基于Spark的大規(guī)模語義數(shù)據(jù)分布式推理框架
發(fā)布時(shí)間:2018-02-24 17:04
本文關(guān)鍵詞: Spark 并行化語義推理 分布式框架 語義大數(shù)據(jù) 出處:《計(jì)算機(jī)科學(xué)》2016年S2期 論文類型:期刊論文
【摘要】:隨著大規(guī)模語義數(shù)據(jù)的涌現(xiàn),研究高效的并行化語義推理成為熱點(diǎn)問題之一。現(xiàn)有推理框架大多存在可擴(kuò)展性方面的不足,難以滿足大規(guī)模語義數(shù)據(jù)的需求。針對(duì)現(xiàn)有推理框架的不足,提出一種基于Spark的大規(guī)模語義數(shù)據(jù)分布式推理框架。該框架主要包括語義建模、規(guī)則提取和基于Spark的并行推理機(jī)等3個(gè)模塊。通過過程分析和推理實(shí)例驗(yàn)證,提出的分布式并行推理的計(jì)算性能(T(n)=O(log_(2)n))遠(yuǎn)遠(yuǎn)優(yōu)于順序式推理的計(jì)算性能(T(n)=O(n))。
[Abstract]:With the emergence of large-scale semantic data, the research of efficient parallel semantic reasoning has become one of the hot issues. It is difficult to meet the needs of large-scale semantic data. A distributed reasoning framework for large-scale semantic data based on Spark is proposed, which mainly includes semantic modeling. Rule extraction and parallel inference engine based on Spark are three modules. Through process analysis and reasoning case verification, the computational performance of distributed parallel reasoning is much better than that of sequential reasoning.
【作者單位】: 大連外國(guó)語大學(xué)軟件學(xué)院;
【基金】:國(guó)家自然科學(xué)基金項(xiàng)目(61371090) 遼寧省自然科學(xué)基金項(xiàng)目(2015020017) 大連外國(guó)語大學(xué)校級(jí)科研項(xiàng)目(2014XJQN09)資助
【分類號(hào)】:TP311.13
,
本文編號(hào):1531018
本文鏈接:http://sikaile.net/kejilunwen/ruanjiangongchenglunwen/1531018.html
最近更新
教材專著