本文選題：通信密集型圖計算 + 內(nèi)存利用率　； 參考：《西安交通大學(xué)學(xué)報》2017年10期

【摘要】：針對通信密集型圖計算環(huán)境下原靜態(tài)最大消息數(shù)閾值方法由于內(nèi)存不足導(dǎo)致的頻繁低效I/O問題,提出了一種基于內(nèi)存利用率的預(yù)計算方法。該方法利用了圖應(yīng)用的計算滿足交換律和結(jié)合律的特點,根據(jù)當(dāng)前進程的內(nèi)存利用率判斷是否將本輪超步通信過程中的部分消息進行預(yù)計算,同時在預(yù)計算過程中使用細粒度鎖以增大預(yù)計算線程的并發(fā)度;在下輪超步的正常計算時合并上輪的預(yù)計算結(jié)果,實現(xiàn)了通信和計算的重疊,達到減少作業(yè)響應(yīng)時間和磁盤I/O開銷的目的。實驗結(jié)果表明,在通信密集場景下,該方法在性能和I/O開銷上均優(yōu)于已有的MMT方法,作業(yè)響應(yīng)時間減少了5.9%~79.0%,同時計算過程中的磁盤開銷減少了9.99%~79.87%。
[Abstract]:Aiming at the frequent and inefficient I / O problem caused by the original static maximum message number threshold method in communication intensive graph computing environment, a precalculation method based on memory utilization is proposed. This method utilizes the calculation of graph application to satisfy the characteristics of switching law and combination law. According to the memory utilization ratio of current process, it determines whether part of the messages in the course of this super-step communication can be pre-calculated. At the same time, the fine granularity lock is used to increase the concurrency degree of the prediction thread in the process of pre-calculation, and when the next wheel overstep is calculated normally, the pre-calculated results of the upper wheel are combined to realize the overlap of communication and calculation. To reduce job response time and disk I / O overhead. The experimental results show that the proposed method is superior to the existing MMT method in performance and I / O overhead in the communication intensive scenario. The response time of the job is reduced by 5.9% 79.0 and the disk overhead in the calculation process is reduced by 9.99% 79.87.
【作者單位】： 西安交通大學(xué)電子與信息工程學(xué)院;深圳信息職業(yè)技術(shù)學(xué)院軟件學(xué)院;
【基金】：國家重點研發(fā)計劃資助項目(2016YFB0201402,2016YFB0201800) 國家自然科學(xué)基金資助項目(61572394) 深圳市科技計劃資助項目(JSGG20140519141854753)
【分類號】：TP333
，

本文編號：2086460