分布式塊級(jí)別存儲(chǔ)系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)
發(fā)布時(shí)間:2018-06-28 19:02
本文選題:塊存儲(chǔ) + 分布式系統(tǒng); 參考:《哈爾濱工業(yè)大學(xué)》2013年碩士論文
【摘要】:隨著人們對(duì)存儲(chǔ)需求的不斷增長(zhǎng)以及新型存儲(chǔ)技術(shù)的快速發(fā)展,存儲(chǔ)系統(tǒng)的發(fā)展日新月異。存儲(chǔ)系統(tǒng)向著大容量、高速度、高可靠性以及易于管理的趨勢(shì)發(fā)展。對(duì)存儲(chǔ)軟件系統(tǒng)和存儲(chǔ)設(shè)備不斷提出更高的要求,而存儲(chǔ)設(shè)備的發(fā)展受到物理硬件本身的制約,存儲(chǔ)容量和穩(wěn)定性都存在一定的限制和瓶頸。特別需要指出的是存儲(chǔ)系統(tǒng)通常與存儲(chǔ)硬件綁定,造成硬件與軟件不能分離,,存儲(chǔ)硬件的更新與替換對(duì)存儲(chǔ)系統(tǒng)的發(fā)展與應(yīng)用帶來(lái)成本和安全性上的損失。 本文設(shè)計(jì)并實(shí)現(xiàn)了塊級(jí)別分布式數(shù)據(jù)存儲(chǔ)系統(tǒng),使用高可用集群將廉價(jià)的普通PC管理起來(lái),提供一塊虛擬的巨大的邏輯存儲(chǔ)空間,在該空間內(nèi)可以任意創(chuàng)建虛擬磁盤,每個(gè)虛擬磁盤分成固定大小的數(shù)據(jù)片分布在不同的物理存儲(chǔ)節(jié)點(diǎn)上。根據(jù)NWR策略創(chuàng)建三份副本分別保存在不同的存儲(chǔ)設(shè)備中,只有一部分設(shè)備損壞不會(huì)影響系統(tǒng)的正常使用。 本系統(tǒng)支持異構(gòu)的存儲(chǔ)設(shè)備,存儲(chǔ)能力大的設(shè)備負(fù)載能力更強(qiáng),系統(tǒng)能夠自動(dòng)根據(jù)不同設(shè)備的負(fù)載能力,按照一定的比例關(guān)系使用每臺(tái)存儲(chǔ)設(shè)備的存儲(chǔ)資源,做到負(fù)載均衡分布,以此優(yōu)化系統(tǒng)設(shè)備的利用率與提高性能。 為了保證數(shù)據(jù)的安全性,針對(duì)虛擬磁盤設(shè)計(jì)了快照功能,使用寫時(shí)拷貝技術(shù)實(shí)現(xiàn)的快照技術(shù)可以快速的對(duì)虛擬磁盤數(shù)據(jù)進(jìn)行差異備份,在不間斷系統(tǒng)運(yùn)行的情況下快速的創(chuàng)建數(shù)據(jù)備份,創(chuàng)建過(guò)快照的虛擬磁盤可以隨時(shí)恢復(fù)。 傳統(tǒng)的存儲(chǔ)技術(shù)發(fā)展到今天,存儲(chǔ)區(qū)域網(wǎng)絡(luò)(SAN)技術(shù)仍然是存儲(chǔ)技術(shù)的主要行業(yè)標(biāo)準(zhǔn),iSCSI協(xié)議是SAN的主要實(shí)現(xiàn)協(xié)議之一,本系統(tǒng)提供塊級(jí)別訪問(wèn)接口,可作為iSCSI Target后端存儲(chǔ)。 經(jīng)驗(yàn)證本分布式存儲(chǔ)系統(tǒng)解決了存儲(chǔ)系統(tǒng)的單點(diǎn)故障問(wèn)題,以去中心化多副本技術(shù)保證了數(shù)據(jù)安全,并且能夠提供PB級(jí)別的存儲(chǔ)能力。論文最后對(duì)系統(tǒng)進(jìn)行了功能性的測(cè)試與集成測(cè)試,并且對(duì)iSCSI的集成也進(jìn)行了功能和性能上的測(cè)試。
[Abstract]:With the increasing demand for storage and the rapid development of new storage technology, storage system is developing with each passing day. Storage systems tend to be large capacity, high speed, high reliability and easy to manage. More and more demands are put forward to storage software system and storage device. The development of storage device is restricted by physical hardware itself. There are some limitations and bottlenecks in storage capacity and stability. It should be pointed out that the storage system is usually bound to the storage hardware, resulting in the hardware and software can not be separated, storage hardware update and replacement of the storage system development and application of the cost and security losses. In this paper, a block level distributed data storage system is designed and implemented. The low cost ordinary PC is managed by using a high availability cluster, which provides a large virtual logical storage space in which virtual disks can be created arbitrarily. Each virtual disk is divided into fixed size pieces of data distributed on different physical storage nodes. According to the NWR policy, three copies are created and stored in different storage devices. Only one part of the device damage will not affect the normal use of the system. The system supports heterogeneous storage devices, and the storage capacity of the devices with large storage capacity is stronger. The system can automatically use the storage resources of each storage device according to the load capacity of different devices and according to a certain proportion. Load balance distribution is achieved to optimize the utilization of system equipment and improve performance. In order to ensure the security of data, the snapshot function is designed for virtual disk. The snapshot technology realized by using write-time copy technology can backup the data of virtual disk quickly. Create a backup of data quickly when the system is running continuously. The virtual disk that has created the snapshot can be recovered at any time. With the development of traditional storage technology, storage area network (San) is still the main industry standard of storage technology, iSCSI protocol is one of the main implementation protocols of San. This system provides block level access interface and can be used as iSCSI Target back-end storage. It is proved that the distributed storage system solves the single point failure problem of the storage system, and the data security is ensured by the decentralized multi-copy technology, and the storage capacity of PB level is provided. Finally, the functional and integration tests of the system are carried out, and the integration of iSCSI is also tested in function and performance.
【學(xué)位授予單位】:哈爾濱工業(yè)大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2013
【分類號(hào)】:TP333
【參考文獻(xiàn)】
相關(guān)期刊論文 前8條
1 易小年;朱釩;;非結(jié)構(gòu)化P2P覆蓋網(wǎng)拓?fù)涮匦苑治鯷J];電腦與信息技術(shù);2008年04期
2 謝斌,高揚(yáng);Linux高可用集群心跳機(jī)制研究[J];計(jì)算機(jī)工程與應(yīng)用;2004年01期
3 徐光平,王剛,劉t
本文編號(hào):2079025
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2079025.html
最近更新
教材專著