本文選題：通信密集型圖計(jì)算 + 內(nèi)存利用率��； 參考：《西安交通大學(xué)學(xué)報》2017年10期

【摘要】：針對通信密集型圖計(jì)算環(huán)境下原靜態(tài)最大消息數(shù)閾值方法由于內(nèi)存不足導(dǎo)致的頻繁低效I/O問題,提出了一種基于內(nèi)存利用率的預(yù)計(jì)算方法。該方法利用了圖應(yīng)用的計(jì)算滿足交換律和結(jié)合律的特點(diǎn),根據(jù)當(dāng)前進(jìn)程的內(nèi)存利用率判斷是否將本輪超步通信過程中的部分消息進(jìn)行預(yù)計(jì)算,同時在預(yù)計(jì)算過程中使用細(xì)粒度鎖以增大預(yù)計(jì)算線程的并發(fā)度;在下輪超步的正常計(jì)算時合并上輪的預(yù)計(jì)算結(jié)果,實(shí)現(xiàn)了通信和計(jì)算的重疊,達(dá)到減少作業(yè)響應(yīng)時間和磁盤I/O開銷的目的。實(shí)驗(yàn)結(jié)果表明,在通信密集場景下,該方法在性能和I/O開銷上均優(yōu)于已有的MMT方法,作業(yè)響應(yīng)時間減少了5.9%~79.0%,同時計(jì)算過程中的磁盤開銷減少了9.99%~79.87%。
[Abstract]:Aiming at the frequent and inefficient I / O problem caused by the original static maximum message number threshold method in communication intensive graph computing environment, a precalculation method based on memory utilization is proposed. This method utilizes the calculation of graph application to satisfy the characteristics of switching law and combination law. According to the memory utilization ratio of current process, it determines whether part of the messages in the course of this super-step communication can be pre-calculated. At the same time, the fine granularity lock is used to increase the concurrency degree of the prediction thread in the process of pre-calculation, and when the next wheel overstep is calculated normally, the pre-calculated results of the upper wheel are combined to realize the overlap of communication and calculation. To reduce job response time and disk I / O overhead. The experimental results show that the proposed method is superior to the existing MMT method in performance and I / O overhead in the communication intensive scenario. The response time of the job is reduced by 5.9% 79.0 and the disk overhead in the calculation process is reduced by 9.99% 79.87.
【作者單位】： 西安交通大學(xué)電子與信息工程學(xué)院;深圳信息職業(yè)技術(shù)學(xué)院軟件學(xué)院;
【基金】：國家重點(diǎn)研發(fā)計(jì)劃資助項(xiàng)目(2016YFB0201402,2016YFB0201800) 國家自然科學(xué)基金資助項(xiàng)目(61572394) 深圳市科技計(jì)劃資助項(xiàng)目(JSGG20140519141854753)
【分類號】：TP333
，

本文編號：2086460