SCMPFS:面向SCM的聚合文件系統(tǒng)
發(fā)布時間:2018-06-18 02:04
本文選題:存儲級內(nèi)存 + 非易失存儲器; 參考:《計算機研究與發(fā)展》2015年S2期
【摘要】:由于NVM器件集成度和DIMM接口數(shù)量的限制,大容量SCM系統(tǒng)中必然包含DIMM接口和PCIe接口NVM存儲設備.這2類NVM存儲設備在訪問接口、訪問方式、I/O性能、存儲容量和內(nèi)嵌處理能力等方面存在很大差異,這使得現(xiàn)有的內(nèi)存和外存均難以直接應用與統(tǒng)一管理2類NVM存儲設備;同時不同文件、文件數(shù)據(jù)與元數(shù)據(jù)、文件內(nèi)各部分數(shù)據(jù)之間的訪問特性和管理要求也不相同,這給高效管理大容量SCM系統(tǒng)帶來了極大的挑戰(zhàn).提出了面向SCM的聚合文件系統(tǒng)SCMPFS,統(tǒng)一管理2類NVM存儲設備.首先給出了聚合文件系統(tǒng)的結(jié)構(gòu);接著給出了元數(shù)據(jù)分層管理算法,具有元數(shù)據(jù)屬性和NVM存儲設備的特性,重構(gòu)元數(shù)據(jù)的組織結(jié)構(gòu),將元數(shù)據(jù)屬性合理分布到2類NVM存儲設備中,提高元數(shù)據(jù)查找速度和管理效率;設計了數(shù)據(jù)聚合管理算法,通過打破文件數(shù)據(jù)的單一組織結(jié)構(gòu)、通過文件數(shù)據(jù)在2類NVM存儲設備之間的合理分布,提高訪問文件的響應速度和文件系統(tǒng)的I/O性能,有效利用2類NVM存儲設備中的存儲容量;最后使用ramfs和PMBD分別模擬DIMM接口和PCIe接口NVM存儲設備,在FUSE的基礎上實現(xiàn)了SCMPFS的原型,使用postmark和Linux內(nèi)核源碼進行了測試與分析,驗證了SCMPFS相比PMBD上Ext3能提高30%~63%的I/O性能,接近與PMFS,同時避免DIMM接口NVM存儲設備容量的限制;此外測試也表明軟件和接口開銷成為影響大容量SCM系統(tǒng)性能的重要因素之一.
[Abstract]:Due to the limitation of the integration of NVM devices and the number of DIMM interfaces, the NVM storage devices with DIMM interface and PCIe interface must be included in the large capacity SCM system. These two kinds of NVM storage devices have great differences in accessing interface, accessing mode and I / O performance, storage capacity and embedded processing ability, which makes it difficult for existing memory and external memory to directly apply and uniformly manage two classes of NVM storage devices. At the same time, the access characteristics and management requirements of different files, file data and metadata as well as the data in each part of the file are different, which brings great challenges to the efficient management of large capacity SCM systems. SCMPFS, an aggregate file system for SCM, is proposed, which manages two classes of NVM storage devices uniformly. Firstly, the structure of the aggregate file system is given, and then the hierarchical management algorithm of metadata is given, which has the properties of metadata and the characteristics of NVM storage device, and reconstructs the organization structure of metadata. In order to improve the speed of metadata lookup and management efficiency, a data aggregation management algorithm is designed to break the single organization structure of file data. Through the reasonable distribution of file data among two NVM storage devices, the response speed of accessing files and the I / O performance of file system are improved, and the storage capacity of two NVM storage devices is utilized effectively. Finally, ramfs and PMBD are used to simulate the DIMM interface and PCIe interface NVM storage device respectively. The prototype of SCMPFS is implemented on the basis of fuse. The postmark and postmark kernel source code is used to test and analyze. It is verified that the I / O performance of SCMPFs can be increased by 30% compared with that on PMBD. It is close to PMFSs and avoids the limitation of storage capacity of DIMM interface NVM storage devices. Besides, the test also shows that software and interface overhead become one of the important factors that affect the performance of large capacity SCM systems.
【作者單位】: 江蘇大學計算機科學與通信工程學院;
【基金】:國家自然科學基金項目(61300228) 江蘇省自然科學基金項目(BK20140570) 江蘇省科技支撐項目(BE2013103) 浙江省自然科學基金項目(LY13F020012) 深圳市科技計劃項目(JCYJ20130401095947222)
【分類號】:TP333
,
本文編號:2033516
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2033516.html
最近更新
教材專著