基于對象存儲文件系統(tǒng)研究
發(fā)布時間:2018-06-01 17:34
本文選題:基于對象存儲 + 文件系統(tǒng); 參考:《電子科技大學(xué)》2012年碩士論文
【摘要】:現(xiàn)今,,越來越多行業(yè)加快了信息化建設(shè),導(dǎo)致數(shù)據(jù)量成倍增加;另一方面,電子制造技術(shù)的不斷突破發(fā)展,使得CPU速度已不再是計算機性能的瓶頸,存儲介質(zhì)價格越來越便宜、容量越來越大。此外,網(wǎng)絡(luò)技術(shù)的飛速發(fā)展更是讓數(shù)據(jù)量成指數(shù)增長,存儲空間不斷擴充,網(wǎng)絡(luò)存儲面臨巨大的挑戰(zhàn)。但是目前的網(wǎng)絡(luò)存儲技術(shù)使用的是傳統(tǒng)接口,導(dǎo)致無法有效應(yīng)對不斷增長的存儲需求;趯ο蟮慕涌,因為同時具備文件和塊接口的特性,成為應(yīng)對存儲壓力的有效方法,受到學(xué)術(shù)界和企業(yè)界廣泛而深入的研究。 基于對象存儲系統(tǒng)(OBS)通過基于對象的接口,將文件系統(tǒng)的存儲管理功能下移到對象存儲設(shè)備(OSD)中,元數(shù)據(jù)服務(wù)器只需簡單的將用戶對文件的請求轉(zhuǎn)化為對應(yīng)的對象標示符,用戶通過對象標示符直接與OSD設(shè)備進行數(shù)據(jù)交互,從而有效減輕了元數(shù)據(jù)服務(wù)器的負載,提高了元數(shù)據(jù)服務(wù)器的響應(yīng)速度以及實際數(shù)據(jù)的傳輸速度。業(yè)界對基于對象存儲的研究主要集中在元數(shù)據(jù)服務(wù)器的設(shè)計和整體性能的提升上,對單個OSD設(shè)備上的本地文件系統(tǒng)研究很少。通常是在OSD設(shè)備上直接使用傳統(tǒng)文件系統(tǒng)結(jié)合對象邏輯層的方法來進行存儲管理,這樣無法充分發(fā)揮基于對象接口的優(yōu)勢,制約了OSD設(shè)備的性能,同時,當(dāng)OSD設(shè)備不斷增加時,單個OSD設(shè)備性能的損失也會嚴重影響整體性能。 為了解決上述問題,本文以基于對象的本地文件系統(tǒng)ZFS為對象,分析對象存儲的實現(xiàn)思想,并加入文件類型識別功能,使得ZFS文件系統(tǒng)能根據(jù)文件類型進行智能的存取,從而提高單個OSD設(shè)備上的存取性能。論文主要工作和成果如下: 1.學(xué)習(xí)基于對象的理論,分析OSD協(xié)議、文件類型識別方法; 2.閱讀ZFS源碼,提取ZFS文件系統(tǒng)中關(guān)鍵數(shù)據(jù)結(jié)構(gòu),分析主要操作的實現(xiàn)過程,理清ZFS代碼整體流程; 3.提取文件類型特征標識符,設(shè)計實現(xiàn)文件類型識別模塊,并加入到ZFS代碼中來實現(xiàn)ZFS智能存。 4.通過實驗驗證本文對ZFS文件系統(tǒng)所做改進。
[Abstract]:Nowadays, more and more industries speed up the construction of information technology, resulting in the increase of data volume. On the other hand, with the development of electronic manufacturing technology, the speed of CPU is no longer the bottleneck of computer performance, and the price of storage media is becoming cheaper and cheaper. The capacity is getting bigger and bigger. In addition, with the rapid development of network technology, the amount of data increases exponentially, the storage space expands continuously, and the network storage is faced with enormous challenges. However, the current network storage technology uses traditional interfaces, which can not effectively cope with the growing demand for storage. Object-based interfaces, because of the characteristics of both file and block interfaces, have become an effective method to deal with storage pressure, which has been extensively and deeply studied by academia and business circles. OBS-based storage system (OBS) moves the storage management function of the file system down to the object storage device (OSDs) through the object-based interface. The metadata server only needs to simply convert the user's request to the file into the corresponding object identifier. The user interacts with the OSD device directly through the object identifier, which effectively reduces the load of the metadata server and improves the response speed of the metadata server and the transmission speed of the actual data. The research of object based storage is mainly focused on the design of metadata server and the improvement of overall performance, but little on the local file system on a single OSD device. Usually, the traditional file system combined with object logic layer is used directly on the OSD device for storage management, which can not give full play to the advantage of the object based interface, which restricts the performance of the OSD device. At the same time, when the OSD device continues to increase, The performance loss of a single OSD device can also seriously affect overall performance. In order to solve the above problems, this paper takes the object based local file system (ZFS) as the object, analyzes the realization idea of the object storage, and adds the file type recognition function to make the ZFS file system access intelligently according to the file type. This improves access performance on a single OSD device. The main work and results are as follows: 1. Learn object based theory, analyze OSD protocol, file type recognition method; 2. Read the ZFS source code, extract the key data structure in the ZFS file system, analyze the implementation process of the main operations, and clarify the overall process of ZFS code; 3. Extract the file type identifier, design and implement the file type identification module, and add it to the ZFS code to realize the intelligent access of ZFS; 4. The improvement of ZFS file system is verified by experiments.
【學(xué)位授予單位】:電子科技大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2012
【分類號】:TP333
【參考文獻】
相關(guān)期刊論文 前3條
1 鄭潔;羅軍勇;蘆斌;;基于統(tǒng)計特征值的文件類型識別算法[J];計算機工程;2007年01期
2 曹鼎;羅軍勇;尹美娟;;基于變長元組的文件類型識別算法[J];計算機應(yīng)用;2011年07期
3 曹鼎;羅軍勇;;改進的基于內(nèi)容的文件類型識別算法[J];計算機工程與設(shè)計;2011年12期
相關(guān)博士學(xué)位論文 前1條
1 曾令仿;基于對象的網(wǎng)絡(luò)存儲智能處理方法研究[D];華中科技大學(xué);2006年
相關(guān)碩士學(xué)位論文 前3條
1 魯春懷;基于對象存儲設(shè)備的文件系統(tǒng)及安全機制的研究[D];華中科技大學(xué);2006年
2 肖維;對象存儲設(shè)備的安全性研究[D];華中科技大學(xué);2007年
3 魯良;基于InfiniBand體系的對象存儲文件系統(tǒng)的研究與實現(xiàn)[D];華中科技大學(xué);2007年
本文編號:1965060
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1965060.html
最近更新
教材專著