【摘要】：隨著信息時(shí)代數(shù)據(jù)量的急劇膨脹,傳統(tǒng)存儲(chǔ)系統(tǒng)如存儲(chǔ)局域網(wǎng)(SAN)和網(wǎng)絡(luò)附加存儲(chǔ)(NAS)采用的均為縱向拓展的架構(gòu),在性能和擴(kuò)展性上已經(jīng)難以滿足海量數(shù)據(jù)的應(yīng)用需求。集群NAS系統(tǒng)技術(shù)采用了橫向拓展的架構(gòu),擁有高性能及易拓展的兩大優(yōu)點(diǎn),已成為當(dāng)前構(gòu)建大型數(shù)據(jù)存儲(chǔ)系統(tǒng)的一種有效解決方式。本文在對(duì)當(dāng)前的集群NAS技術(shù)進(jìn)行研究的基礎(chǔ)上,選擇了基于集群文件系統(tǒng)的方式,結(jié)合現(xiàn)有的成熟穩(wěn)定的開源軟件,設(shè)計(jì)并實(shí)現(xiàn)了一個(gè)集群NAS系統(tǒng)CLNASFS。CLNASFS具有高性能、高可拓展能力、高可用、存儲(chǔ)空間利用率高等特點(diǎn),適用于視頻編輯、科學(xué)技術(shù)、視頻監(jiān)控、共享文件存儲(chǔ)等對(duì)存儲(chǔ)系統(tǒng)的性能、容量及可用性要求高的領(lǐng)域。CLNASFS基于集群文件系統(tǒng)Gluster FS、開源CIFS服務(wù)器Samba、高可用組件CTDB構(gòu)建,可對(duì)外提供包括CIFS、NFS、HTTP等多種訪問協(xié)議。該系統(tǒng)采用了無元數(shù)據(jù)服務(wù)器模型,通過文件和目錄的拓展文件屬性來管理系統(tǒng)的元數(shù)據(jù),避免了單點(diǎn)故障問題。本系統(tǒng)所設(shè)計(jì)實(shí)現(xiàn)的核心技術(shù)包括:基于類型的數(shù)據(jù)布局策略、高可用監(jiān)視模塊、服務(wù)器端基于硬件的實(shí)時(shí)文件壓縮系統(tǒng)等。其中本文提出的基于類型的數(shù)據(jù)布局策略還可以被應(yīng)用于其他的Key/Value存儲(chǔ)系統(tǒng)中,具有較大參考價(jià)值。同時(shí)服務(wù)器端基于硬件的實(shí)時(shí)壓縮文件系統(tǒng)既可以在CLNASFS中作為服務(wù)器端的壓縮模塊使用,也可以單獨(dú)使用配合i SCSI協(xié)議對(duì)外作為提供壓縮功能的塊設(shè)備使用。最后,通過對(duì)比測試,驗(yàn)證了CLNASFS系統(tǒng)在性能、可拓展性、可用性及壓縮功能上的優(yōu)勢,證明了該系統(tǒng)的穩(wěn)定性及其內(nèi)部各種技術(shù)的有效性。
[Abstract]:With the rapid expansion of data in the information age, the traditional storage systems, such as (SAN) and (NAS), are both vertically extended, so it is difficult to meet the application requirements of mass data in performance and expansibility. Cluster NAS system technology adopts the architecture of horizontal expansion and has the advantages of high performance and easy to expand. It has become an effective solution to construct large data storage system. Based on the research of the current cluster NAS technology, this paper chooses the method of cluster file system, and combines the existing mature and stable open source software, designs and implements a cluster NAS system CLNASFS.CLNASFS with high performance. High scalability, high availability, high storage space utilization and other characteristics, suitable for video editing, science and technology, video surveillance, shared file storage and other storage system performance, CLNASFS is based on the cluster file system Gluster FS, open source CIFS server Samba, high availability component CTDB which can provide multiple access protocols including CIFS,NFS,HTTP. The system adopts the model of no metadata server, and manages the metadata of the system by extending the file attributes of files and directories, thus avoiding the problem of single point of failure. The core technologies of this system include: data layout strategy based on type, high availability monitoring module, real-time file compression system based on hardware on the server side and so on. The data layout strategy based on type proposed in this paper can also be applied to other Key/Value storage systems, which is of great reference value. At the same time, the hardware-based real-time compressed file system can be used not only in CLNASFS as the compression module on the server side, but also as a block device with I SCSI protocol. Finally, the advantages of CLNASFS system in performance, expansibility, availability and compression function are verified by comparing tests. The stability of the system and the effectiveness of various internal technologies are proved.
【學(xué)位授予單位】：國防科學(xué)技術(shù)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2013
【分類號(hào)】：TP333;TP311.52
，

本文編號(hào)：2265852