海量遙感數(shù)據(jù)交換技術(shù)研究與應(yīng)用
本文選題:數(shù)據(jù)快速分發(fā) 切入點(diǎn):安全可靠交換 出處:《河南大學(xué)》2014年碩士論文 論文類型:學(xué)位論文
【摘要】:遙感行業(yè)應(yīng)用多數(shù)為數(shù)據(jù)密集型,同時(shí)計(jì)算密集型應(yīng)用,提高遙感系統(tǒng)的時(shí)效性,,不僅需要考慮提高系統(tǒng)對(duì)數(shù)據(jù)的處理能力,還需要考慮如何縮短傳輸時(shí)延,隨著用戶量的增加會(huì)導(dǎo)致隨之而來的網(wǎng)絡(luò)流量的增加,用戶將會(huì)面臨越來越多的數(shù)據(jù)傳輸時(shí)延和傳輸失敗。如今,如何提高整個(gè)系統(tǒng)的數(shù)據(jù)處理吞吐量,如何安全可靠快速地傳遞待處理數(shù)據(jù),如何降低數(shù)據(jù)傳輸和存儲(chǔ)系統(tǒng)的維護(hù)成本,如何降低應(yīng)用程序耦合程度,增強(qiáng)可擴(kuò)展性和可伸縮性,這些都已經(jīng)成為遙感行業(yè)應(yīng)用系統(tǒng)發(fā)展和建設(shè)過程中亟待解決的問題。本文采用REST(Representational State Transfer)架構(gòu)實(shí)現(xiàn)遙感應(yīng)用后臺(tái)數(shù)據(jù)交換系統(tǒng),充分利用現(xiàn)有的HTTP/JSON等網(wǎng)絡(luò)技術(shù),有效地彌補(bǔ)了傳統(tǒng)網(wǎng)絡(luò)架構(gòu)的不足,在保持提供簡(jiǎn)潔高效的客戶端接口前提下,著力提高遙感應(yīng)用后臺(tái)數(shù)據(jù)交換系統(tǒng)的可伸縮性,提供低成本的擴(kuò)容和維護(hù)方法。REST架構(gòu)風(fēng)格特別適合資源型服務(wù)接口的設(shè)計(jì),將服務(wù)器上的共享的遙感數(shù)據(jù)看作資源,使用HTTP、URI、XML以及HTML這些廣泛使用的協(xié)議和標(biāo)準(zhǔn)讓W(xué)eb服務(wù)重歸其成功的關(guān)鍵——簡(jiǎn)單。消費(fèi)Web服務(wù)的客戶端或者瀏覽器通過資源標(biāo)識(shí)符去操作資源,REST架構(gòu)風(fēng)格的開發(fā)方式使得系統(tǒng)結(jié)構(gòu)更加簡(jiǎn)明。本文采用REST架構(gòu)風(fēng)格實(shí)現(xiàn)了一個(gè)分布式的海量遙感數(shù)據(jù)安全可靠分發(fā)系統(tǒng),并對(duì)該系統(tǒng)的性能和可行性進(jìn)行了驗(yàn)證,主要成果有以下3點(diǎn): (1)實(shí)現(xiàn)GF應(yīng)用系統(tǒng)前后端海量數(shù)據(jù)同步協(xié)同功能:通過資源注冊(cè)與管理,使前后端能夠自動(dòng)地進(jìn)行關(guān)于元數(shù)據(jù)的信息交流,從而保證前后端海量數(shù)據(jù)及時(shí)同步協(xié)同。 (2)實(shí)現(xiàn)海量GF數(shù)據(jù)共享服務(wù)的安全可靠交換功能:研究開發(fā)了面向不同前后端的GF數(shù)據(jù)交換中間件以支持TB級(jí)的空間數(shù)據(jù)安全交換,為GF應(yīng)用數(shù)據(jù)的安全交換提供基礎(chǔ)。 (3)實(shí)現(xiàn)海量數(shù)據(jù)快速分發(fā)功能:為滿足大數(shù)據(jù)量、大量用戶高并發(fā)訪問環(huán)境下提供穩(wěn)定低延時(shí)的海量遙感數(shù)據(jù)訪問服務(wù)的需要,為GF應(yīng)用提供基礎(chǔ)數(shù)據(jù)傳輸支撐,本文提出使用基于一致性哈希(Consistent Hashing)實(shí)現(xiàn)網(wǎng)絡(luò)緩存(Web Caching)系統(tǒng)。
[Abstract]:Most remote sensing applications are data-intensive and computationally intensive to improve the timeliness of remote sensing systems. It is necessary not only to consider how to improve the system's ability to process data, but also to consider how to shorten the transmission delay. With the increase in the number of users will lead to the subsequent increase in network traffic, users will face more and more data transmission delays and transmission failures. Nowadays, how to improve the data processing throughput of the whole system, How to transfer data to be processed safely, reliably and quickly, how to reduce the maintenance cost of data transmission and storage system, how to reduce the degree of application coupling, and how to enhance scalability and scalability. All of these have become the problems to be solved in the development and construction of remote sensing application system. In this paper, we use REST(Representational State transfer architecture to realize the background data exchange system of remote sensing application, and make full use of existing network technologies such as HTTP/JSON, etc. Effectively make up for the shortcomings of the traditional network architecture, while maintaining a simple and efficient client interface, focus on improving the remote sensing application background data exchange system scalability, Provides low-cost expansion and maintenance methods. Rest architectural style is particularly suited to the design of resource-based service interfaces, treating shared remote sensing data on servers as resources, The key to bringing Web services back to success using HTTP uri XML and widely used protocols and standards such as HTML is simple. Clients or browsers consuming Web Services manipulate Resource rest Architecture-style Development via Resource identifiers. This paper uses REST architecture style to implement a distributed security and reliable distribution system for mass remote sensing data. The performance and feasibility of the system are verified. The main results are as follows:. 1) realizing the synchronization and cooperation function of massive data in front and rear end of GF application system: through resource registration and management, the front and rear end can automatically exchange information about metadata, so as to ensure timely synchronization and cooperation of mass data in front and rear end. 2) realizing the secure and reliable exchange function of massive GF data sharing service: the GF data exchange middleware for different front and rear end is developed to support the terabyte level spatial data security exchange, which provides the basis for the secure exchange of GF application data. In order to meet the needs of large amount of data and large amount of users in high concurrent access environment, to provide stable and low delay mass remote sensing data access service, and to provide basic data transmission support for GF application, In this paper, a Consistent Hashing-based network cache (Cache) system is proposed.
【學(xué)位授予單位】:河南大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2014
【分類號(hào)】:TP79
【參考文獻(xiàn)】
相關(guān)期刊論文 前10條
1 李帥;王永麗;楊寶祝;;基于SOA的數(shù)據(jù)服務(wù)中間件的研究與實(shí)現(xiàn)[J];成都信息工程學(xué)院學(xué)報(bào);2010年05期
2 劉賢三;張新;梁碧苗;池天河;;海洋GIS時(shí)空數(shù)據(jù)模型與應(yīng)用[J];測(cè)繪科學(xué);2010年06期
3 范凱;;NoSQL數(shù)據(jù)庫(kù)綜述[J];程序員;2010年06期
4 李文中;顧鐵成;周俊;陸桑璐;陳道蓄;;適應(yīng)性Web緩存的研究[J];計(jì)算機(jī)科學(xué);2005年04期
5 王甫棣;林潤(rùn)生;胡英楣;;基于Web服務(wù)的氣象數(shù)據(jù)服務(wù)[J];計(jì)算機(jī)工程;2009年08期
6 孟令奎;夏輝宇;陳子丹;李繼園;;基于P2P的海量水利遙感影像優(yōu)化傳輸策略[J];計(jì)算機(jī)應(yīng)用研究;2011年04期
7 溫彥;劉晨;韓燕波;;iViewer:利用數(shù)據(jù)服務(wù)即時(shí)生成跨域數(shù)據(jù)視圖[J];計(jì)算機(jī)科學(xué)與探索;2012年03期
8 賀明霞;賀雙顏;王云飛;楊倩;唐軍武;胡傳民;;中國(guó)衛(wèi)星海洋觀測(cè)系統(tǒng)及其傳感器(1988—2025)[J];中國(guó)海洋大學(xué)學(xué)報(bào)(自然科學(xué)版);2011年12期
9 張彥軍;姚國(guó)祥;周洋;;基于P2P的教育資源網(wǎng)絡(luò)設(shè)計(jì)[J];計(jì)算機(jī)工程與設(shè)計(jì);2006年15期
10 李博霏;李欣;李艷明;;基于瀏覽器的地理信息服務(wù)客戶端技術(shù)研究[J];計(jì)算機(jī)工程與設(shè)計(jì);2011年09期
本文編號(hào):1573081
本文鏈接:http://sikaile.net/guanlilunwen/gongchengguanli/1573081.html