本文選題：數(shù)字博物館 + HDFS　； 參考：《浙江大學(xué)》2013年碩士論文

【摘要】：數(shù)據(jù)存儲(chǔ)系統(tǒng)是數(shù)字博物館體系架構(gòu)的核心部分。在當(dāng)前數(shù)字博物館資源快速增長(zhǎng)的環(huán)境下,數(shù)字博物館海量資源對(duì)數(shù)據(jù)存儲(chǔ)和管理系統(tǒng)提出了新的挑戰(zhàn)。本文針對(duì)當(dāng)前數(shù)字博物館海量數(shù)據(jù)存儲(chǔ)和管理方法存在的若干問(wèn)題,主要研究了數(shù)字博物館海量多媒體小文件的存儲(chǔ)和多尺度空間數(shù)據(jù)的管理技術(shù),分別提出了基于HDFS的小文件合并策略和基于HBase的海量文物空間數(shù)據(jù)的管理技術(shù)。取得的主要成果如下： 一、根據(jù)數(shù)字博物館包含大量多媒體小文件資源的特點(diǎn),提出了一種基于HDFS的海量多媒體小文件合并存儲(chǔ)策略,其基本思想是將大量的小文件合并成大的聚簇文件后,一起保存到HDFS中,該策略相比于原始的HDFS,有效地減少了大量小文件對(duì)主節(jié)點(diǎn)的內(nèi)存消耗,提高了文件寫入性能,同時(shí)為聚簇文件中的小文件建立文件索引,降低了文件的讀取時(shí)間。 二、研究了文物的多尺度空間數(shù)據(jù)的特點(diǎn),提出了一種適于海量多尺度空間數(shù)據(jù)的POZ空間填充曲線及基于HBase的文物多尺度空間數(shù)據(jù)存儲(chǔ)模型,實(shí)現(xiàn)對(duì)海量多尺度空間數(shù)據(jù)的管理和快速訪問(wèn),與傳統(tǒng)關(guān)系數(shù)據(jù)存儲(chǔ)方法對(duì)比,該方法在管理海量文物的多尺度空間數(shù)據(jù)方面優(yōu)秀性能。 三、最后我們基于本文的研究成果,設(shè)計(jì)并部署了數(shù)字博物館海量數(shù)據(jù)的分布式存儲(chǔ)系統(tǒng),系統(tǒng)的構(gòu)建采用三層體系結(jié)構(gòu),即存儲(chǔ)層、組織層和數(shù)據(jù)訪問(wèn)層；存儲(chǔ)層采用HDFS分布式文件系統(tǒng),提供海量數(shù)據(jù)存儲(chǔ)能力；組織層基于HBase提供結(jié)構(gòu)化的數(shù)據(jù)組織,同時(shí)實(shí)現(xiàn)了多媒體小文件合并和文物的多尺度空問(wèn)數(shù)據(jù)的管理；數(shù)據(jù)訪問(wèn)層是系統(tǒng)與上層應(yīng)用的交互接口,主要提供數(shù)據(jù)操作和數(shù)據(jù)管理功能。
[Abstract]:Data storage system is the core of digital museum architecture.With the rapid growth of digital museum resources, massive digital museum resources pose a new challenge to the data storage and management system.Aiming at some problems existing in the methods of storing and managing mass data in digital museum, this paper mainly studies the storage of mass multimedia small files and the management technology of multi-scale spatial data in digital museum.The small file merging strategy based on HDFS and the management technology of massive cultural relic spatial data based on HBase are put forward respectively.The main results achieved are as follows:First, according to the characteristic that the digital museum contains a large number of multimedia small file resources, this paper proposes a large amount of multimedia small file merge and storage strategy based on HDFS, its basic idea is to merge a large number of small files into large cluster files.Compared with the original HDFS, this strategy can effectively reduce the memory consumption of a large number of small files to the master node, improve the performance of file writing, and index the small files in cluster files.Reduced the read time of the file.Secondly, the characteristics of multi-scale spatial data of cultural relics are studied, and a POZ spatial filling curve suitable for massive multi-scale spatial data and a storage model of cultural relic multi-scale spatial data based on HBase are proposed.Compared with the traditional relational data storage method, this method has excellent performance in managing the multi-scale spatial data of massive cultural relics.Finally, based on the research results of this paper, we design and deploy the distributed storage system of mass data in digital museum. The system is constructed with three layers: storage layer, organization layer and data access layer.The storage layer uses HDFS distributed file system to provide massive data storage, organization layer provides structured data organization based on HBase, and realizes multimedia small file merging and multi-scale spatial data management.The data access layer is the interface between the system and the upper application, which mainly provides data operation and data management functions.
【學(xué)位授予單位】：浙江大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2013
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前4條

1 吳偉波,曹文君;對(duì)于數(shù)字化博物館實(shí)現(xiàn)中的一些關(guān)鍵技術(shù)的研究與實(shí)踐[J];復(fù)旦學(xué)報(bào)(自然科學(xué)版);2001年06期

2 陳剛;;數(shù)字博物館概念、特征及其發(fā)展模式探析[J];中國(guó)博物館;2007年03期

3 熊麗華,楊峰;基于ArcSDE的空間數(shù)據(jù)庫(kù)技術(shù)的應(yīng)用研究[J];計(jì)算機(jī)應(yīng)用;2004年03期

4 楊向明;;數(shù)字博物館及其相關(guān)問(wèn)題[J];中原文物;2006年01期

相關(guān)博士學(xué)位論文 前1條

1 王銳;數(shù)字博物館資源虛擬化與數(shù)據(jù)集成方法研究[D];山東大學(xué);2010年

，

本文編號(hào)：1749566