地理柵格數(shù)據(jù)并行訪問(wèn)技術(shù)研究與實(shí)現(xiàn)
發(fā)布時(shí)間:2018-04-16 09:39
本文選題:地理計(jì)算 + 地理柵格數(shù)據(jù) ; 參考:《國(guó)防科學(xué)技術(shù)大學(xué)》2012年碩士論文
【摘要】:隨著對(duì)地觀測(cè)技術(shù)的長(zhǎng)足發(fā)展,海量地理空間數(shù)據(jù)日益增長(zhǎng),地理計(jì)算也越來(lái)越呈現(xiàn)出數(shù)據(jù)密集型和計(jì)算密集型的特點(diǎn)。如今以并行計(jì)算集群、多核處理器為代表的新型硬件設(shè)施逐漸成為主流,它們?yōu)閺?fù)雜地理計(jì)算提供了高性能的計(jì)算能力。然而,I/O性能的增長(zhǎng)并沒(méi)有跟上計(jì)算性能的增長(zhǎng)步伐,從而限制了對(duì)海量空間數(shù)據(jù)的處理能力,成為影響復(fù)雜地理計(jì)算整體性能的瓶頸,,所以對(duì)并行地理計(jì)算中I/O問(wèn)題的研究具有重要的意義和價(jià)值。本文圍繞“面向地理柵格數(shù)據(jù)的并行訪問(wèn)技術(shù)”這一主題,從以下幾個(gè)方面展開了深入研究。 首先,通過(guò)研究地理計(jì)算的特點(diǎn),分析并行處理中數(shù)據(jù)I/O模式的讀寫時(shí)間、數(shù)據(jù)劃分時(shí)間和通信時(shí)間之間的關(guān)系,建立了地理計(jì)算中數(shù)據(jù)I/O的代價(jià)模型,并通過(guò)實(shí)驗(yàn)分析比較了分發(fā)收集式和并行I/O兩種代價(jià)模型的特點(diǎn),為設(shè)計(jì)和實(shí)現(xiàn)地理柵格數(shù)據(jù)處理的并行訪問(wèn)方法提供了理論和實(shí)驗(yàn)依據(jù)。 其次,分析現(xiàn)有并行文件存儲(chǔ)模型的特點(diǎn)及其適用條件,針對(duì)復(fù)雜地理計(jì)算任務(wù)的特點(diǎn),設(shè)計(jì)面向地理柵格數(shù)據(jù)的并行訪問(wèn)模式,設(shè)計(jì)了支持多源地理柵格數(shù)據(jù)的抽象數(shù)據(jù)模型,并實(shí)現(xiàn)了地理柵格數(shù)據(jù)并行訪問(wèn)接口,為復(fù)雜地理計(jì)算算法的開發(fā)提供支持。 再次,基于并行訪問(wèn)模式,提出了面向地理柵格數(shù)據(jù)的并行I/O框架,設(shè)計(jì)實(shí)現(xiàn)了地理柵格數(shù)據(jù)并行訪問(wèn)算法,提供了一種復(fù)雜地理計(jì)算算法中數(shù)據(jù)并行I/O的編程模式,并通過(guò)實(shí)驗(yàn)驗(yàn)證了并行I/O模型能夠提高地理計(jì)算算法的整體性能。 最后,論文基于并行集群環(huán)境,實(shí)現(xiàn)了地理柵格數(shù)據(jù)并行I/O訪問(wèn)技術(shù)在數(shù)字地形分析和地圖可視化中的應(yīng)用,并通過(guò)實(shí)驗(yàn)驗(yàn)證了算法的正確性和高效性。 綜上所述,通過(guò)對(duì)面向地理柵格數(shù)據(jù)的并行訪問(wèn)技術(shù)進(jìn)行研究,有效地改善了地理柵格數(shù)據(jù)的訪問(wèn)效率,為大幅度提升并行地理計(jì)算的整體性能提供技術(shù)支撐。
[Abstract]:With the rapid development of Earth observation technology, the massive geospatial data is increasing day by day, and the geographical calculation is more and more data-intensive and computation-intensive.Nowadays, new hardware facilities, represented by parallel computing clusters and multi-core processors, are gradually becoming the mainstream. They provide high performance computing power for complex geographic computing.However, the growth of I / O performance has not kept pace with the increase in computing performance, which limits the processing capacity of massive spatial data and becomes a bottleneck affecting the overall performance of complex geographic computing.Therefore, the study of I / O problem in parallel geographic computing is of great significance and value.This paper focuses on the topic of "parallel access technology for geo-grid data", which is studied from the following aspects.First of all, by studying the characteristics of geographic computing, the paper analyzes the relationship among the reading and writing time, data partition time and communication time of data I / O mode in parallel processing, and establishes the cost model of data I / O in geographic computing.The characteristics of the two cost models of distributed collection and parallel I / O are analyzed and compared, which provides a theoretical and experimental basis for the design and implementation of parallel access methods for geographic grid data processing.Secondly, the characteristics of the existing parallel file storage models and their applicable conditions are analyzed. According to the characteristics of complex geographical computing tasks, a parallel access mode for geographic grid data is designed.The abstract data model supporting multi-source geographic raster data is designed, and the parallel access interface of geographical raster data is implemented, which provides support for the development of complex geographic computing algorithm.Thirdly, based on the parallel access mode, a parallel I / O framework for geo-grid data is proposed, and a parallel access algorithm for geo-raster data is designed and implemented, which provides a programming model of data parallel I / O in complex geographic computing algorithm.Experimental results show that the parallel I / O model can improve the overall performance of the algorithm.Finally, based on the parallel cluster environment, the paper realizes the application of the parallel I / O access technology in the digital terrain analysis and map visualization, and verifies the correctness and efficiency of the algorithm through experiments.To sum up, through the research of the parallel access technology for geographic grid data, the efficiency of geographical grid data access is improved effectively, and the technical support is provided for improving the overall performance of parallel geographic computing.
【學(xué)位授予單位】:國(guó)防科學(xué)技術(shù)大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2012
【分類號(hào)】:TP338.6
【參考文獻(xiàn)】
相關(guān)期刊論文 前1條
1 周毓麟,沈隆鈞;高性能計(jì)算的應(yīng)用及戰(zhàn)略地位[J];中國(guó)科學(xué)院院刊;1999年03期
本文編號(hào):1758370
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1758370.html
最近更新
教材專著