基于NBD機(jī)制的高性能計(jì)算機(jī)系統(tǒng)內(nèi)存優(yōu)化方案
發(fā)布時(shí)間：2018-09-04 10:51
【摘要】：隨著多核、異構(gòu)等計(jì)算機(jī)技術(shù)的飛速發(fā)展,高性能計(jì)算機(jī)的計(jì)算性能現(xiàn)已達(dá)到億億次量級(jí).隨著高性能計(jì)算機(jī)技術(shù)的成熟,高性能應(yīng)用對(duì)系統(tǒng)內(nèi)存產(chǎn)生不同的需求.超級(jí)計(jì)算機(jī)每個(gè)結(jié)點(diǎn)都按一定標(biāo)準(zhǔn)配置了內(nèi)存,在實(shí)際使用中,因不同應(yīng)用對(duì)于內(nèi)存需求量的不同,很容易出現(xiàn)有的結(jié)點(diǎn)空閑內(nèi)存較多,而有的結(jié)點(diǎn)內(nèi)存緊張的情況.為較好地運(yùn)行內(nèi)存消耗量大的高性能應(yīng)用,提出了一種基于網(wǎng)絡(luò)塊設(shè)備(network block device,NBD)機(jī)制使用遠(yuǎn)程結(jié)點(diǎn)內(nèi)存構(gòu)建page swap區(qū)的內(nèi)存優(yōu)化技術(shù).該技術(shù)利用了超級(jí)計(jì)算機(jī)中通過(guò)網(wǎng)絡(luò)訪問(wèn)遠(yuǎn)地內(nèi)存性能優(yōu)于訪問(wèn)本地磁盤性能的特點(diǎn),采用了遠(yuǎn)程內(nèi)存交換盤技術(shù),使得本地節(jié)點(diǎn)在內(nèi)存緊張時(shí)可將頁(yè)面交換到遠(yuǎn)地節(jié)點(diǎn)的物理內(nèi)存上.并將該技術(shù)應(yīng)用到"天河一號(hào)"超級(jí)計(jì)算機(jī)系統(tǒng)上,以測(cè)試其性能并提高超級(jí)計(jì)算機(jī)的內(nèi)存使用效率.
[Abstract]:With the rapid development of multi-core, heterogeneous computer technology, the computing performance of high performance computer has reached billions of times. With the maturity of high-performance computer technology, high-performance applications have different requirements for system memory. Each node of a supercomputer has allocated memory according to certain standards. In practice, due to the difference of memory requirements in different applications, it is easy to find some nodes have more free memory and some nodes have tight memory. In order to run high performance applications with large memory consumption, a memory optimization technique based on network block device (network block device,NBD) is proposed to construct page swap region using remote node memory. This technology takes advantage of the performance of accessing remote memory over network in supercomputers to access local disks, and adopts the technology of remote memory switch disk. Allows local nodes to swap pages to the physical memory of remote nodes when memory is tight. The technology is applied to the "Tianhe-1" supercomputer system to test its performance and improve the memory efficiency of the supercomputer.
【作者單位】： 國(guó)防科學(xué)技術(shù)大學(xué)計(jì)算機(jī)學(xué)院;
【分類號(hào)】：TP38;TP333
，
本文編號(hào)：2221864
[Abstract]:With the rapid development of multi-core, heterogeneous computer technology, the computing performance of high performance computer has reached billions of times. With the maturity of high-performance computer technology, high-performance applications have different requirements for system memory. Each node of a supercomputer has allocated memory according to certain standards. In practice, due to the difference of memory requirements in different applications, it is easy to find some nodes have more free memory and some nodes have tight memory. In order to run high performance applications with large memory consumption, a memory optimization technique based on network block device (network block device,NBD) is proposed to construct page swap region using remote node memory. This technology takes advantage of the performance of accessing remote memory over network in supercomputers to access local disks, and adopts the technology of remote memory switch disk. Allows local nodes to swap pages to the physical memory of remote nodes when memory is tight. The technology is applied to the "Tianhe-1" supercomputer system to test its performance and improve the memory efficiency of the supercomputer.
【作者單位】： 國(guó)防科學(xué)技術(shù)大學(xué)計(jì)算機(jī)學(xué)院;
【分類號(hào)】：TP38;TP333
，
本文編號(hào)：2221864
本文鏈接：http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2221864.html
最近更新
教材專著
