發(fā)布時(shí)間：2019-02-13 08:51

【摘要】：如何為上層應(yīng)用和計(jì)算提供穩(wěn)定高效的文件I/O性能,是分布式文件系統(tǒng)性能研究的熱點(diǎn)。文中分析分布式文件系統(tǒng)在設(shè)計(jì)機(jī)理上的共同特征,基于此提出一種通用型的啟發(fā)式文件預(yù)取模型,并選取HDFS平臺(tái)進(jìn)行系統(tǒng)實(shí)現(xiàn)。啟發(fā)式文件預(yù)取對(duì)上層應(yīng)用透明,采用在文件系統(tǒng)內(nèi)部建立預(yù)取線程池的方法,以組成文件塊的數(shù)據(jù)存儲(chǔ)文件為預(yù)取單位,在分布式文件系統(tǒng)內(nèi)部實(shí)現(xiàn)。這種設(shè)計(jì)思路具有一定的普適性,適合推廣應(yīng)用于多種分布式文件系統(tǒng)。實(shí)驗(yàn)結(jié)果表明,所述的啟發(fā)式文件預(yù)取,能夠有效提升分布式文件系統(tǒng)的I/O性能。
[Abstract]:How to provide stable and efficient file I / O performance for upper layer application and computing is a hot topic in the research of distributed file system performance. This paper analyzes the common features of the design mechanism of distributed file system, and proposes a general heuristic file prefetching model based on this, and selects HDFS platform to implement the system. The heuristic file prefetching is transparent to the upper application. The prefetching thread pool is set up in the file system. The data storage file that consists of the file block is used as the prefetching unit, and it is implemented in the distributed file system. This design idea has certain universality and is suitable for popularizing and applying to many distributed file systems. Experimental results show that the heuristic prefetching can effectively improve the I / O performance of distributed file systems.
【作者單位】： 北京航天飛行控制中心;航天飛行動(dòng)力學(xué)技術(shù)重點(diǎn)實(shí)驗(yàn)室;北京航空航天大學(xué)計(jì)算機(jī)學(xué)院中德聯(lián)合軟件研究所;
【基金】：國(guó)家“十二五”863計(jì)劃信息技術(shù)領(lǐng)域重大項(xiàng)目“云計(jì)算關(guān)鍵技術(shù)與系統(tǒng)”課題:以公眾漢語服務(wù)為主的搜索引擎研制(2011AA01A205)資助
【分類號(hào)】：TP333;TP316.4

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 劉偉;劉露;陳犖;鐘志農(nóng);;海量遙感影像數(shù)據(jù)存儲(chǔ)技術(shù)研究[J];計(jì)算機(jī)工程;2009年05期

2 何公明;張?jiān)獫?;面向數(shù)字媒體的高性能分布式存儲(chǔ)系統(tǒng)的研究與應(yīng)用[J];廣播電視信息;2009年10期

3 許春聰;黃小猛;吳諾;孫寧偉;楊廣文;;分布式文件系統(tǒng)存儲(chǔ)介質(zhì)評(píng)測(cè)與分析[J];計(jì)算機(jī)學(xué)報(bào);2010年10期

4 吳英;謝廣軍;劉t，

本文編號(hào)：2421374