【摘要】：對(duì)象存儲(chǔ)提供了跨平臺(tái)、高可靠性、高性能的存儲(chǔ)體系結(jié)構(gòu)，滿足了大規(guī)模數(shù)據(jù)的存儲(chǔ)需求。但是，對(duì)象存儲(chǔ)系統(tǒng)也會(huì)遇到讀寫性能瓶頸，在存儲(chǔ)設(shè)備性能提升有限的情況下，緩存技術(shù)的發(fā)展提供了有效的解決方案。 針對(duì)Cappella文件系統(tǒng)，設(shè)計(jì)了一種基于分布式對(duì)象文件系統(tǒng)的緩存策略。在對(duì)象服務(wù)器端實(shí)現(xiàn)了一套用戶態(tài)的緩存方案，達(dá)到了對(duì)原有緩存方案的優(yōu)化和完善。緩存策略實(shí)現(xiàn)了緩存空間的統(tǒng)一管理和調(diào)度，提高了緩存空間分配和回收的效率，并能對(duì)緩存資源使用情況做出智能的響應(yīng)，對(duì)緩存讀寫策略進(jìn)行調(diào)節(jié)與控制。當(dāng)緩存資源使用率達(dá)到上限值時(shí)，緩存策略開始啟動(dòng)寫緩存持久化和讀緩存淘汰操作。當(dāng)緩存資源使用率降低到下限值時(shí)，，再停止讀緩存的淘汰操作。寫緩存持久化操作將把前一時(shí)間窗口內(nèi)寫入緩存的數(shù)據(jù)持久化到磁盤，讀緩存淘汰操作將依次釋放讀緩存權(quán)值較低的緩存資源。 緩存寫策略實(shí)現(xiàn)了數(shù)據(jù)的延遲寫入和聚合，有效的減少了寫時(shí)延和寫磁盤的次數(shù)。緩存讀策略能根據(jù)讀請(qǐng)求的特點(diǎn)，優(yōu)化數(shù)據(jù)的讀取，實(shí)現(xiàn)了順序預(yù)讀和緩存部分命中條件下的讀方案優(yōu)化選擇。緩存策略通過直接I/O方式，能在較少內(nèi)存使用率下，不依賴Linux內(nèi)核頁高速緩存實(shí)現(xiàn)更好的讀寫性能。結(jié)合實(shí)際環(huán)境對(duì)相關(guān)參數(shù)進(jìn)行優(yōu)化配置，緩存策略也可以很好的利用在其他分布式對(duì)象文件系統(tǒng)上。 測試結(jié)果表明，緩存策略實(shí)現(xiàn)了對(duì)原有方案的較大優(yōu)化。在大文件順序讀寫的情況下比Linux內(nèi)核頁高速緩存性能更優(yōu)。
[Abstract]:Object storage provides a cross-platform, high-reliability, high-performance storage architecture to meet the storage needs of large-scale data. However, the object storage system also meets the bottleneck of read and write performance. With the limited performance improvement of storage devices, the development of cache technology provides an effective solution. A cache strategy based on distributed object file system is designed for Cappella file system. A user caching scheme is implemented on the object server, which optimizes and perfects the original cache scheme. Cache policy realizes the unified management and scheduling of cache space, improves the efficiency of cache space allocation and recovery, and can make an intelligent response to the use of cache resources, and adjusts and controls the cache read and write policy. When the cache resource utilization reaches the upper limit, the cache policy starts the write cache persistence and read cache elimination operations. When cache resource utilization is reduced to a lower limit, the read cache phase out is stopped. The write cache persistence operation will persist the data written in the previous time window to disk and the read cache elimination operation will release the cache resources with lower read cache weight in turn. The cache write strategy realizes the delayed writing and aggregation of data, and effectively reduces the write delay and the number of write disks. The cache reading strategy can optimize the reading of data according to the characteristics of the read request and realize the optimal selection of the reading scheme under the condition of sequential prereading and partial hit of cache. The caching strategy can achieve better read and write performance without relying on Linux kernel page cache without less memory usage through direct I / O mode. Combined with the actual environment to optimize the configuration of the relevant parameters, the cache strategy can also be used in other distributed object file systems. The test results show that the cache policy achieves a large optimization of the original scheme. In the case of large file sequential reading and writing than the Linux kernel page cache performance is better.
【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2013
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前2條

1 黃華,張建剛,許魯;藍(lán)鯨分布式文件系統(tǒng)的分布式分層資源管理模型[J];計(jì)算機(jī)研究與發(fā)展;2005年06期

2 傅湘林;謝長生;曹強(qiáng);劉朝斌;;一種融合NAS和SAN技術(shù)的存儲(chǔ)網(wǎng)絡(luò)系統(tǒng)[J];計(jì)算機(jī)科學(xué);2003年02期

本文編號(hào)：2186149