面向Julia的云計算技術研究
發(fā)布時間：2018-11-07 19:18
【摘要】：高性能計算機以其強大的計算能力，成為科學與工程計算的有力工具。在中小企業(yè)的創(chuàng)新計算過程中，需要共享使用超級計算機，卻因編程復雜而難以實施。Julia語言是一門新出現(xiàn)的開源腳本語言，從語言級支持高性能計算，易于編寫高性能程序。云計算技術為優(yōu)秀的計算資源共享模式。本文嘗試構建了面向Julia的云計算平臺，降低企業(yè)用戶編寫調試并行程序難度的同時，實現(xiàn)多用戶共享超級計算資源。本文的主要工作有： (1)面向Julia語言的云服務平臺框架：分析Julia語言的并行特性，結合云服務特點，設計了包含前端系統(tǒng)(程序編輯環(huán)境、用戶管理、作業(yè)管理)、后端系統(tǒng)(會話控制、作業(yè)調度、狀態(tài)管理)和消息通信系統(tǒng)三個子系統(tǒng)的高性能云服務平臺框架。 (2)基于消息中間件的消息通信系統(tǒng)：定義了可擴展文本消息格式，設計了基于ActiveMQ服務的消息通信機制。通過實現(xiàn)該消息機制，降低了前端系統(tǒng)和后端系統(tǒng)的耦合性，使系統(tǒng)能適應異構環(huán)境，，便于構建高可擴展的高性能云服務平臺。 (3)云服務平臺的后端系統(tǒng)：采用虛擬化技術搭建了一個并行計算平臺，并完成相應環(huán)境配置。在此基礎上，針對并行編程和資源管理，初步設計、實現(xiàn)了高層次抽象編程模型和作業(yè)管理系統(tǒng)。 (4)公交線路走行時長統(tǒng)計的計算案例：基于云服務平臺，實現(xiàn)了公交線路走行時長統(tǒng)計的計算案例。計算案例中對比了串行算法和并行優(yōu)化算法在本項目的云服務平臺上的運行效率。實驗證明，Julia程序從串行模式到并行模式僅添加較少指令，程序短小精煉。優(yōu)化算法的執(zhí)行時間縮短了70%。 面向Julia的高性能云服務平臺為企業(yè)創(chuàng)新提供了易用的高性能程序編程環(huán)境，構建了企業(yè)用戶與高性能計算資源間的橋梁。
[Abstract]:High-performance computer has become a powerful tool for scientific and engineering calculation with its powerful computing power. In the process of innovative computing in small and medium-sized enterprises, it is necessary to share and use supercomputers, but it is difficult to implement because of the complexity of programming. Julia language is a new open source scripting language, which supports high performance computing from the language level and is easy to write high performance programs. Cloud computing technology is an excellent computing resource sharing model. This paper attempts to construct a cloud computing platform for Julia to reduce the difficulty for enterprise users to write and debug parallel programs and to realize multi-user sharing of supercomputing resources at the same time. The main work of this paper is as follows: (1) the framework of cloud service platform oriented to Julia language: analyzing the parallel characteristics of Julia language, combining the characteristics of cloud service, designing the front-end system (program editing environment, user management, job management). The high performance cloud service platform framework of back-end system (session control, job scheduling, state management) and message communication system. (2) message communication system based on message middleware: the extensible text message format is defined and the message communication mechanism based on ActiveMQ service is designed. By implementing the message mechanism, the coupling between front-end system and back-end system is reduced, the system can adapt to heterogeneous environment, and it is convenient to construct a high scalable cloud service platform with high performance. (3) the back-end system of cloud service platform: a parallel computing platform is built with virtualization technology, and the corresponding environment is configured. On this basis, a high-level abstract programming model and a job management system are designed for parallel programming and resource management. (4) calculation case of bus route travel time statistics: based on cloud service platform, the calculation case of bus route travel time statistics is realized. The operation efficiency of serial algorithm and parallel optimization algorithm on cloud service platform is compared. Experiments show that the Julia program only adds fewer instructions from serial mode to parallel mode, and the program is short and refined. The execution time of the optimization algorithm is shortened by 70. The high performance cloud service platform for Julia provides an easy to use high performance programming environment for enterprise innovation and builds a bridge between enterprise users and high performance computing resources.
【學位授予單位】：石家莊鐵道大學
【學位級別】：碩士
【學位授予年份】：2014
【分類號】：TP312.1;TP393.09
本文編號：2317326
[Abstract]:High-performance computer has become a powerful tool for scientific and engineering calculation with its powerful computing power. In the process of innovative computing in small and medium-sized enterprises, it is necessary to share and use supercomputers, but it is difficult to implement because of the complexity of programming. Julia language is a new open source scripting language, which supports high performance computing from the language level and is easy to write high performance programs. Cloud computing technology is an excellent computing resource sharing model. This paper attempts to construct a cloud computing platform for Julia to reduce the difficulty for enterprise users to write and debug parallel programs and to realize multi-user sharing of supercomputing resources at the same time. The main work of this paper is as follows: (1) the framework of cloud service platform oriented to Julia language: analyzing the parallel characteristics of Julia language, combining the characteristics of cloud service, designing the front-end system (program editing environment, user management, job management). The high performance cloud service platform framework of back-end system (session control, job scheduling, state management) and message communication system. (2) message communication system based on message middleware: the extensible text message format is defined and the message communication mechanism based on ActiveMQ service is designed. By implementing the message mechanism, the coupling between front-end system and back-end system is reduced, the system can adapt to heterogeneous environment, and it is convenient to construct a high scalable cloud service platform with high performance. (3) the back-end system of cloud service platform: a parallel computing platform is built with virtualization technology, and the corresponding environment is configured. On this basis, a high-level abstract programming model and a job management system are designed for parallel programming and resource management. (4) calculation case of bus route travel time statistics: based on cloud service platform, the calculation case of bus route travel time statistics is realized. The operation efficiency of serial algorithm and parallel optimization algorithm on cloud service platform is compared. Experiments show that the Julia program only adds fewer instructions from serial mode to parallel mode, and the program is short and refined. The execution time of the optimization algorithm is shortened by 70. The high performance cloud service platform for Julia provides an easy to use high performance programming environment for enterprise innovation and builds a bridge between enterprise users and high performance computing resources.
【學位授予單位】：石家莊鐵道大學
【學位級別】：碩士
【學位授予年份】：2014
【分類號】：TP312.1;TP393.09
【參考文獻】
相關期刊論文 前10條
1 李碩;唐勝男;;高性能計算機體系結構綜述[J];北京工商大學學報(自然科學版);2007年06期
2 孫健;賈曉菁;;Google云計算平臺的技術架構及對其成本的影響研究[J];電信科學;2010年01期
3 魏文國,謝贊福;Linux集群系統(tǒng)技術研究[J];廣東技術師范學院學報;2003年06期
4 曹建文,潘峰,姚繼鋒,孫家昶,趙國忠;并行油藏模擬軟件的實現(xiàn)及在國產(chǎn)高性能計算機上的應用[J];計算機研究與發(fā)展;2002年08期
5 馮國珍;基于數(shù)字溫度傳感器DS18B20的分布式測溫系統(tǒng)的設計[J];吉林化工學院學報;2003年03期
6 黎康保,陶文正,許麗華,黎文樓;用PC機群組構并行超級計算機[J];計算機工程;2000年09期
7 徐晶,許煒;消息中間件綜述[J];計算機工程;2005年16期
8 郭本俊;王鵬;陳高云;黃健;;基于MPI的云計算模型[J];計算機工程;2009年24期
9 陳全;鄧倩妮;;云計算及其關鍵技術[J];計算機應用;2009年09期
10 程伍端;;計算機虛擬化技術的分析與應用[J];計算機與數(shù)字工程;2008年11期
本文編號：2317326
本文鏈接：http://sikaile.net/guanlilunwen/ydhl/2317326.html
最近更新
教材專著
