【摘要】：隨著林業(yè)信息化建設(shè)的推進(jìn),越來(lái)越多的新技術(shù)、新方法在林業(yè)上得到了應(yīng)用。要對(duì)森林領(lǐng)域進(jìn)行深入的研究,森林資源監(jiān)測(cè)數(shù)據(jù)的獲取是必不可少的�，F(xiàn)在,我國(guó)森林資源監(jiān)測(cè)對(duì)像多(如氣候、土壤、水文、水質(zhì)、視頻等),分布范圍廣,采集的數(shù)據(jù)量大,數(shù)據(jù)的形式多樣,結(jié)構(gòu)不統(tǒng)一。只有對(duì)辛苦得來(lái)的寶貴森林監(jiān)測(cè)數(shù)據(jù)進(jìn)行有效的存儲(chǔ)、管理和利用,才能對(duì)林業(yè)問(wèn)題的分析、決策提供客觀、全面的支持。本文針對(duì)森林資源監(jiān)測(cè)數(shù)據(jù)的大數(shù)據(jù)問(wèn)題,不同類型數(shù)據(jù)的存儲(chǔ)問(wèn)題以及數(shù)據(jù)的并行存儲(chǔ)和計(jì)算問(wèn)題,進(jìn)行了以下研究。 首先,針對(duì)森林資源監(jiān)測(cè)數(shù)據(jù)分布范圍廣,相互間相對(duì)孤立以及監(jiān)測(cè)數(shù)據(jù)量大等問(wèn)題。本文提出了一種基于Glusterfs的森林資源監(jiān)測(cè)云平臺(tái)的構(gòu)建方法；通過(guò)云平臺(tái)的構(gòu)建,可以解決各地區(qū)監(jiān)測(cè)數(shù)據(jù)相對(duì)孤立的問(wèn)題,把所有的監(jiān)測(cè)數(shù)據(jù)存儲(chǔ)在構(gòu)建的統(tǒng)一虛擬資源存儲(chǔ)池中,實(shí)現(xiàn)數(shù)據(jù)的邏輯統(tǒng)一,有利于數(shù)據(jù)的共享和存儲(chǔ)資源利用率的提高。 其次,針對(duì)森林資源監(jiān)測(cè)數(shù)據(jù)格式和類型的多樣性等問(wèn)題。本文通過(guò)分析森林監(jiān)測(cè)數(shù)據(jù)的邏輯結(jié)構(gòu),大致將監(jiān)測(cè)數(shù)據(jù)分為結(jié)構(gòu)化數(shù)據(jù)和非結(jié)構(gòu)化數(shù)據(jù),并設(shè)計(jì)了一種混合式的存儲(chǔ)機(jī)制,即根據(jù)數(shù)據(jù)的不同類型將其分別存儲(chǔ)在關(guān)系型數(shù)據(jù)庫(kù)和NoSQL數(shù)據(jù)庫(kù)中；從而解決了不同數(shù)據(jù)類型的數(shù)據(jù)在同一系統(tǒng)中存儲(chǔ)的問(wèn)題。 再次,針對(duì)系統(tǒng)數(shù)據(jù)存儲(chǔ)的均衡性問(wèn)題,本文運(yùn)用了一致性哈希算法,從而使得整個(gè)系統(tǒng)的數(shù)據(jù)存儲(chǔ)和計(jì)算更加均衡；針對(duì)數(shù)據(jù)處理過(guò)程中的并行化問(wèn)題,本文設(shè)計(jì)的基于Glusterfs的森林監(jiān)測(cè)云平臺(tái),采用MapReduce計(jì)算模型和并行數(shù)據(jù)庫(kù)技術(shù),實(shí)現(xiàn)了數(shù)據(jù)的并行化計(jì)算和存儲(chǔ)。 最后,本文對(duì)搭建的簡(jiǎn)易Glusterfs云平臺(tái)的可靠性、擴(kuò)展性、彈性及消除元數(shù)據(jù)性能等方面做了測(cè)試。實(shí)驗(yàn)結(jié)果表明系統(tǒng)整體性能優(yōu)異。同時(shí),在鎖問(wèn)題和文件遍歷問(wèn)題上還需要繼續(xù)改進(jìn)。
[Abstract]:With the development of forestry information construction, more and more new technologies and methods have been applied in forestry. The acquisition of forest resources monitoring data is essential to the in-depth study of the forest field. At present, there are many monitoring objects (such as climate, soil, hydrology, water quality, video, etc.) in China, which have a wide range of distribution, large amount of data collected, various forms of data, and disunity of structure. Only through the effective storage, management and utilization of valuable forest monitoring data can we provide objective and comprehensive support for the analysis and decision making of forestry problems. In this paper, big data problem of forest resource monitoring data, storage problem of different types of data and parallel storage and computation of data are studied as follows. Firstly, aiming at the problems of wide distribution of forest resources monitoring data, relative isolation of each other and large amount of monitoring data, etc. In this paper, a method of constructing forest resource monitoring cloud platform based on Glusterfs is put forward, which can solve the problem of relative isolation of monitoring data in different regions. All the monitoring data are stored in the unified virtual resource storage pool to realize the logical unification of the data, which is conducive to the sharing of data and the improvement of the utilization rate of storage resources. Secondly, aiming at the diversity of forest resources monitoring data format and type, etc. By analyzing the logical structure of forest monitoring data, this paper roughly divides the monitoring data into structured data and unstructured data, and designs a hybrid storage mechanism. According to different types of data, they are stored in relational database and NoSQL database respectively, thus solving the problem of different data types stored in the same system. Thirdly, aiming at the equalization of system data storage, this paper uses the consistent hash algorithm to make the data storage and computation more balanced in the whole system, and aiming at the parallelization problem in the process of data processing, The forest monitoring cloud platform based on Glusterfs is designed in this paper. The parallel computing and storage of data is realized by using MapReduce computing model and parallel database technology. Finally, the reliability, extensibility, elasticity and performance of the simple Glusterfs cloud platform are tested. The experimental results show that the overall performance of the system is excellent. At the same time, the problems of lock and file traversal still need to be improved.
【學(xué)位授予單位】：東北林業(yè)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2014
【分類號(hào)】：S757.2

【參考文獻(xiàn)】

相關(guān)期刊論文 前5條

1 段孝國(guó);;分布式計(jì)算技術(shù)介紹[J];電腦知識(shí)與技術(shù);2011年22期

2 錢宏蕊;;云存儲(chǔ)技術(shù)發(fā)展及應(yīng)用[J];電信工程技術(shù)與標(biāo)準(zhǔn)化;2012年04期

3 張樹鴻,何斌,林作銓;基于Agent的數(shù)據(jù)庫(kù)中間件[J];計(jì)算機(jī)工程與應(yīng)用;2001年24期

4 袁滿;何輔賢;陳丹;奚雪峰;;一個(gè)基于云平臺(tái)的教學(xué)資源管理系統(tǒng)[J];信息技術(shù);2013年08期

5 頓卉;;如何利用云存儲(chǔ)技術(shù)提升財(cái)務(wù)軟件數(shù)據(jù)處理效率[J];商場(chǎng)現(xiàn)代化;2013年12期

相關(guān)博士學(xué)位論文 前3條

1 曾志;云格環(huán)境下海量高分遙感影像資源與服務(wù)高效調(diào)配研究[D];浙江大學(xué);2012年

2 陳穎文;無(wú)線傳感器網(wǎng)絡(luò)低能耗數(shù)據(jù)查詢關(guān)鍵技術(shù)研究[D];國(guó)防科學(xué)技術(shù)大學(xué);2007年

3 周云霞;智能網(wǎng)絡(luò)磁盤存儲(chǔ)關(guān)鍵技術(shù)研究[D];中南大學(xué);2011年

，

本文編號(hào)：2275081