基于MapReduce的高階矩陣乘法分布式并行算法研究
發(fā)布時間:2018-04-11 01:23
本文選題:MapReduce + 高階矩陣 ; 參考:《小型微型計算機系統(tǒng)》2015年12期
【摘要】:高階矩陣的存儲和處理在信息、經(jīng)濟、生物等學(xué)科領(lǐng)域都有十分重要的應(yīng)用,但是由于單節(jié)點計算機CPU、內(nèi)存等資源的限制,導(dǎo)致了對高階矩陣的處理存在一定的困難.在研究云計算平臺Hadoop及其核心組件MapReduce的基礎(chǔ)上,研究實現(xiàn)了處理高階矩陣乘法的通用并行算法(內(nèi)積法),在此基礎(chǔ)上,對內(nèi)積法進行了改進,提出一種基于緩存的分布式并行算法(緩存法),通過實驗仿真表明,緩存法相比內(nèi)積法執(zhí)行效率更高,不僅適合處理高階稀疏矩陣,而且可以處理高階稠密矩陣,并且在并行效果上接近理論線性加速比.
[Abstract]:The storage and processing of high order matrices are very important in the fields of information, economy, biology and so on. However, because of the limitation of resources such as single node computer CPU and memory, it is difficult to deal with higher order matrices.Based on the research of cloud computing platform Hadoop and its core component MapReduce, a general parallel algorithm (inner product method) for dealing with high order matrix multiplication is developed. On this basis, the inner product method is improved.A cache based distributed parallel algorithm (cache method) is proposed. The experimental results show that the cache method is more efficient than the inner product method, which is not only suitable for dealing with high order sparse matrix, but also can deal with high order dense matrix.And the parallel effect is close to the theoretical linear speedup.
【作者單位】: 中國地質(zhì)大學(xué)武漢計算機學(xué)院;
【基金】:國家自然科學(xué)基金青年項目(61305087,61402425)資助;國家自然科學(xué)基金面上項目(61272470)資助 中國博士后科學(xué)基金項目(2014M562086)資助
【分類號】:TP338.8
【參考文獻】
相關(guān)期刊論文 前2條
1 張駿;;一種基于MapReduce并行框架的大規(guī)模矩陣乘法運算的實現(xiàn)[J];計算機應(yīng)用與軟件;2012年06期
2 孫遠帥;陳W,
本文編號:1733815
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1733815.html
最近更新
教材專著