本文選題：分布式文件系統(tǒng) + 元數(shù)據(jù)��； 參考：《上海交通大學(xué)》2012年碩士論文

【摘要】：伴隨全球數(shù)據(jù)量的飛速增長和數(shù)據(jù)密集型應(yīng)用的不斷增加,分布式文件系統(tǒng)得到越來越廣泛的應(yīng)用。目前主流的分布式文件系統(tǒng)均采用將元數(shù)據(jù)與數(shù)據(jù)分離管理的機(jī)制,將命名空間和文件元數(shù)據(jù)保存在元數(shù)據(jù)節(jié)點(diǎn),而數(shù)據(jù)保存在數(shù)據(jù)節(jié)點(diǎn)。很顯然,元數(shù)據(jù)節(jié)點(diǎn)的高可用是決定分布式存儲(chǔ)系統(tǒng)的可用性的關(guān)鍵因素。 本文對(duì)分布式文件系統(tǒng)中的元數(shù)據(jù)高可用性技術(shù)進(jìn)行了全面。深入研究,并在此基礎(chǔ)上設(shè)計(jì)和實(shí)現(xiàn)了BlueOcean分布式文件系統(tǒng)元數(shù)據(jù)服務(wù)器高可用方案。本文的主要工作如下: (1)研究了分布式文件系統(tǒng)中元數(shù)據(jù)管理的關(guān)鍵問題,包括文件系統(tǒng)元數(shù)據(jù)職責(zé)。分布式元數(shù)據(jù)管理方式。命名空間分布策略等; (2)研究了可用性相關(guān)知識(shí)及常用高可用系統(tǒng)組織模式,將不同的高可用組織模式對(duì)系統(tǒng)性能及恢復(fù)時(shí)間的影響進(jìn)行了比較; (3)研究了提高分布式文件系統(tǒng)元數(shù)據(jù)服務(wù)器可用性的關(guān)鍵技術(shù),設(shè)計(jì)并實(shí)現(xiàn)了碧海分布式文件系統(tǒng)元數(shù)據(jù)服務(wù)器高可用方案,在設(shè)計(jì)過程中對(duì)元數(shù)據(jù)復(fù)制。服務(wù)器狀態(tài)監(jiān)測。失敗確認(rèn)及接管。節(jié)點(diǎn)恢復(fù)后的處理等關(guān)鍵問題進(jìn)行了詳細(xì)分析; (4)對(duì)實(shí)現(xiàn)后的高可用系統(tǒng)設(shè)計(jì)了實(shí)驗(yàn)方案進(jìn)行了測試。結(jié)果表明,該高可用設(shè)計(jì)方案對(duì)元數(shù)據(jù)操作性能和系統(tǒng)整體性能影響都比較小,且在進(jìn)行大文件訪問時(shí)性能影響可以忽略;系統(tǒng)可在元數(shù)據(jù)服務(wù)器異常停機(jī)后的一分鐘時(shí)間里完成系統(tǒng)服務(wù)的恢復(fù)。
[Abstract]:With the rapid growth of global data volume and the increasing of data-intensive applications, distributed file systems have been more and more widely used. At present, the mainstream distributed file systems adopt the mechanism of separating metadata from data, and keep namespace and file metadata in metadata nodes, while data are stored in data nodes. Obviously, the high availability of metadata nodes is the key factor to determine the availability of distributed storage systems. In this paper, the technology of high availability of metadata in distributed file system is discussed. The high availability scheme of BlueOcean distributed file system metadata server is designed and implemented. The main work of this paper is as follows: 1) the key issues of metadata management in distributed file system, including the metadata responsibility of file system, are studied. Distributed metadata management. Namespace distribution strategy; Secondly, the knowledge of usability and the organization pattern of commonly used high availability system are studied, and the effects of different high availability organization modes on system performance and recovery time are compared. The key technology of improving the availability of distributed file system metadata server is studied, and the high availability scheme of Bihai distributed file system metadata server is designed and implemented. Server status monitoring. Fail to confirm and take over. The key issues such as node recovery are analyzed in detail. Finally, the experimental scheme of the high availability system is designed and tested. The results show that the high availability design scheme has little effect on the performance of metadata and the whole system, and it can be neglected when accessing large files. The system can complete the recovery of the system service in a minute after the metadata server outages.
【學(xué)位授予單位】：上海交通大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP368.5

【引證文獻(xiàn)】

相關(guān)碩士學(xué)位論文 前2條

1 田怡萌;BlueOcean海量存儲(chǔ)系統(tǒng)Windows客戶端設(shè)計(jì)與實(shí)現(xiàn)[D];上海交通大學(xué);2013年

2 程煜;BlueOcean海量存儲(chǔ)系統(tǒng)高并發(fā)客戶端的設(shè)計(jì)與實(shí)現(xiàn)[D];上海交通大學(xué);2013年

，

本文編號(hào)：1809044