本文選題：極區(qū)空間物理 + 科學數(shù)據(jù)管理��； 參考：《華東師范大學》2017年碩士論文

【摘要】：極區(qū)空間物理主要研究南北兩極的大氣層、電離層和磁層中的物理現(xiàn)象,隨著數(shù)字化科學儀器的發(fā)展,極區(qū)空間物理研究已成為數(shù)據(jù)密集型的科學研究。目前使用的觀測儀器大致可以分為電離層、地磁和極光觀測三類。不同觀測儀器采集的數(shù)據(jù)的類型、結構各不相同,是典型的多維結構的科學數(shù)據(jù),數(shù)據(jù)規(guī)模已經(jīng)累積達到了 TB甚至PB級別。如何對這些海量的多維科學數(shù)據(jù)進行有效組織,并提供快速查詢等數(shù)據(jù)服務以支持極區(qū)空間物理的研究,成為亟待解決的問題。針對關系數(shù)據(jù)庫和NoSQL數(shù)據(jù)庫的數(shù)據(jù)模型在表達多維科學數(shù)據(jù)上存在的先天缺陷和管理科學數(shù)據(jù)的高昂代價,本文基于Array數(shù)據(jù)模型設計并實現(xiàn)了海量極區(qū)空間物理數(shù)據(jù)的組織與服務框架。Array數(shù)據(jù)模型專為多維結構的數(shù)據(jù)設計,可以容易地表達多維科學數(shù)據(jù),對多維科學數(shù)據(jù)的運算支持良好。本文對Array數(shù)據(jù)模型進行了擴展,增加了對元數(shù)據(jù)的支持,設計了 ArrayPlus數(shù)據(jù)模型用以表達極區(qū)空間物理數(shù)據(jù),通過元數(shù)據(jù)管理器的設計,基于Array數(shù)據(jù)庫Rasdaman提供了對ArrayPlus數(shù)據(jù)模型的支持�？紤]到極光圖像數(shù)據(jù)載入數(shù)據(jù)庫的代價過高,本文設計了 Aurora Vault來實現(xiàn)極光圖像的原位處理功能。同時,針對Rasdaman在數(shù)據(jù)分發(fā)功能上的不足,本文設計了分布式調度器,支持對Aurora Vault的分布式調度。在此基礎上,面向極區(qū)空間物理數(shù)據(jù)的管理需求,設計了數(shù)據(jù)服務,提供了數(shù)據(jù)導入、可視化、基本統(tǒng)計、下載、極光圖像處理等功能,使用Java語言實現(xiàn)了海量極區(qū)空間物理數(shù)據(jù)的組織與服務原型系統(tǒng)。最后,本文比較分析了基于關系數(shù)據(jù)庫、基于NoSQL數(shù)據(jù)庫和基于本文擴展的Rasdaman的數(shù)據(jù)訪問代價,通過地磁、極光、宇宙噪聲三類極區(qū)空間物理數(shù)據(jù)的8個典型查詢案例,選取MySQL、Mongodb、HBase與本文的研究進行了比較實驗。實驗過程表明,基于本文擴展的Rasdaman實現(xiàn)查詢需求的代價明顯小于其余三者;實驗結果表明,基于本文擴展的Rasdaman的查詢性能明顯優(yōu)于其余三者,也進一步說明了本文設計的海量極區(qū)空間物理數(shù)據(jù)的組織與服務框架的有效性。
[Abstract]:Polar space physics mainly studies the physical phenomena in the atmosphere, ionosphere and magnetosphere of the northern and southern poles. With the development of digital scientific instruments, polar space physics research has become data-intensive scientific research. The observational instruments used at present can be divided into ionospheric, geomagnetic and auroral observations. The types and structures of data collected by different observation instruments are typical multi-dimensional scientific data. The scale of data has accumulated to TB or PB level. How to organize these massive multi-dimensional scientific data effectively and provide fast query and other data services to support the research of polar spatial physics has become an urgent problem. Aiming at the inherent defects in the expression of multidimensional scientific data and the high cost of managing scientific data, the data models of relational database and NoSQL database are used to express the multi-dimensional scientific data. Based on the Array data model, this paper designs and implements the organization and service framework of massive polar spatial physical data. The data model is specially designed for multidimensional data structure, which can easily express multidimensional scientific data. Good operation support for multidimensional scientific data. In this paper, the Array data model is extended to support metadata, and the ArrayPlus data model is designed to express polar spatial physical data. Rasdaman provides support for ArrayPlus data model based on Array database. Considering the high cost of loading auroral image data into database, Aurora Vault is designed to realize in situ processing of aurora image. At the same time, aiming at the deficiency of Rasdaman in data distribution, this paper designs a distributed scheduler to support the distributed scheduling of Aurora Vault. On this basis, to meet the management requirements of polar spatial physical data, a data service is designed to provide functions such as data import, visualization, basic statistics, download, aurora image processing, etc. The prototype system of organizing and serving massive polar spatial physical data is implemented by using Java language. Finally, this paper compares and analyzes the data access cost based on relational database, NoSQL database and extended Rasdaman. Eight typical query cases of spatial physical data in polar region of geomagnetic, auroral and cosmic noise are analyzed. A comparative experiment was carried out between MySQL MongodbHase and this study. The experimental results show that the cost of implementing query requirements based on the extended Rasdaman is obviously lower than that of the other three, and the experimental results show that the query performance of the extended Rasdaman is obviously better than that of the other three. Furthermore, the validity of the organization and service framework of the massive polar spatial physical data designed in this paper is further illustrated.
【學位授予單位】：華東師范大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TP311.13

【參考文獻】

相關期刊論文 前3條

1 王赤;任麗文;;日地空間探索之旅——空間物理探測最新進展與展望(上)[J];國際太空;2015年01期

2 何f ;胡紅橋;楊惠根;胡澤駿;;兩種靜日曲線推算方法生成宇宙噪聲吸收Keogram二維演化特征的比較研究[J];地球物理學報;2015年01期

3 劉瑞源;楊惠根;;中國極區(qū)高空大氣物理學觀測研究進展[J];極地研究;2011年04期

，

本文編號：1877007