云計算資源調度方法改進與應用設計
發(fā)布時間：2018-08-06 13:34
【摘要】：論文云計算資源調度方法改進與應用設計,針對國內外云計算的商業(yè)特性及服務模式,對云計算服務中高并發(fā)、高實時性的在線服務模式提出了更高的要求,而傳統的資源調度策略下,僅僅對虛擬化計算、內存、存儲和網絡資源進行分配,導致LC(Latency Critical)負載服務時延過長、平臺整體服務質量較差的現實,研究了在此背景下新興的CAT(Cache Allocation Technology)技術,創(chuàng)新性地提出了使用PID(Proportion Integration Differentiation)算法作為資源調度的控制器,利用WCP主板作為多芯片處理器(CMPs)的平臺,搭配Intel?Xeon?E5系列的處理器,實現在Mesos資源調度系統的基礎上,提出針對多核、多芯片環(huán)境下緩存資源的調度方法,彌補了業(yè)界在緩存資源控制方面的缺陷,其選題具有較強的針對性和實用性。為此研究了在Linux操作系統下,利用Mesos資源調度系統和Marathon框架,搭建并模擬了一個master節(jié)點、兩個slave節(jié)點的Mesos集群環(huán)境,測試了Marathon框架的負載啟動過程,資源分配方式及狀態(tài)監(jiān)控功能。在進一步的研究中,利用WCP主板和Intel?Xeon?E5系列的處理器作為硬件服務平臺,結合Mesos、Marathon和Docker容器技術,通過使用C語言在Linux系統中完成了PCM數據監(jiān)控模塊、PID控制模塊、前端參數讀取模塊、后端數據寫入模塊的設計,并利用SQL語言在Linux系統下完成了Mysql數據庫的設計,包括前端參數存儲和后端數據存儲的表結構,在此基礎上利用HTML、JavaScript語言完成了后端數據可視化系統的設計,進行了四種后端數據動態(tài)展示、PID控制開關、PID算法參數配置、負載添加及擴展功能的設計。該項目的研究對促進云計算資源調度技術的發(fā)展具有一定的參考價值。論文的研究工作主要體現在如下幾個方面:其一,研究了國內外云計算資源調度方法的現狀和最新成果,結合傳統資源分配方式存在的局限性,進行了CAT緩存分配技術、PID自動控制算法、云計算資源調度技術、Docker容器技術的分析,重點分析了云計算資源調度方法中的自動控制模塊的工作原理及協議標準。其二,研究了Mesos資源調度系統和Marathon框架的相關技術,在對相關平臺和軟件進行對比和選擇基礎上,在三臺Linux主機中利用Linux Shell命令分別安裝上一個Mesos master節(jié)點,兩個Mesos slave節(jié)點,并在每個節(jié)點上安裝PID控制器,搭建了一個小型的Mesos集群,利用Docker容器技術對負載進行容器化封裝,進行了PID控制器的功能測試和性能測試,以此掌握整個Mesos集群中各個主節(jié)點、控制節(jié)點間的通信過程。其三,進行了PID控制器的設計,使負載具備通過PID控制項來自動調整性能數據的功能,并可由PCM數據監(jiān)控項來將實時數據發(fā)送至控制器內部,作為真實數據與控制器中的目標數據求取差值,通過PID控制算法的數學公式求出控制輸出值,并根據此輸出值控制緩存資源的分配。此外還進行了Mysql數據庫的設計,使后端數據及前端參數實現數據的持久化,能夠存儲來自前后端程序的數據。其四,進行了后端數據可視化系統的設計,研究了Web服務器的工作原理及工作模式,通過對PID控制器可視化需求的分析,選擇合適的Web服務器并利用HTML和JavaScript語言開發(fā)了包括數據動態(tài)展示、控制按鈕、參數調整欄框、負載添加欄框的設計和功能測試。其五,將整個系統軟硬件連接在一起做整體的功能測試和性能測試,包括啟動負載,設置緩存資源的大小、后端數據存儲,前端數據讀取,數據動態(tài)展示等測試,選取多種LC負載與其他負載進行性能測試。測試結果表明,系統整體達到預定設計的要求。
[Abstract]:The improvement and application design of cloud computing resource scheduling method, aiming at the business characteristics and service mode of cloud computing at home and abroad, put forward higher requirements for high concurrency and high real-time online service mode in cloud computing service, and the traditional resource scheduling strategy only distributes the virtual computing, memory, storage and network resources. The LC (Latency Critical) load service delay is too long and the overall service quality of the platform is poor. Under this background, the new CAT (Cache Allocation Technology) technology is studied. The PID (Proportion Integration Differentiation) algorithm is used as the controller of the resource scheduling, which uses the WCP main board as the multi core. The platform of chip processor (CMPs), with the processor of Intel? Xeon? E5 series, is implemented on the basis of the Mesos resource scheduling system, and proposes a scheduling method for the caching resources in the multi core and multi chip environment, which makes up for the defects in the field of caching resources control, and its selection has a strong pertinence and practicability. Therefore, a study on Linux is made in this paper. Under the operating system, the Mesos resource scheduling system and the Marathon framework are used to build and simulate the Mesos cluster environment of a master node and two slave nodes. The load starting process, the resource allocation mode and the state monitoring function of the Marathon framework are tested. In further research, the WCP master and Intel Xeon E5 series processor are used in further research. As a hardware service platform, combined with Mesos, Marathon and Docker container technology, the PCM data monitoring module, PID control module, the front end parameter reading module, the back end data write module are designed in the Linux system using the C language, and the Mysql database is designed with the SQL language in the Linux system, including the front end parameter memory. The table structure of storage and back end data storage is built on this basis by using HTML and JavaScript language to design the back end data visualization system. Four kinds of back end data dynamic display, PID control switch, PID algorithm parameter configuration, load addition and extension function are designed. The research of this project promotes the technology of cloud computing resource scheduling. Development has a certain reference value. The research work of this paper is mainly embodied in the following aspects: first, it studies the current situation and latest achievements of cloud computing resource scheduling methods at home and abroad, and combines the limitations of traditional resource allocation methods, and carries out CAT cache allocation technology, PID automatic control algorithm, cloud computing resource scheduling technology, Doc The analysis of Ker container technology focuses on the principle and protocol standard of the automatic control module in the cloud computing resource scheduling method. Secondly, the related technologies of the Mesos resource scheduling system and the Marathon framework are studied. On the basis of the comparison and selection of the related platforms and software, the Linux Shell command is used in three Linux hosts. Install a Mesos master node, two Mesos slave nodes respectively, and install PID controller on each node, build a small Mesos cluster, use the Docker container technology to container the load, carry out the function test and performance test of the PID controller, so as to master the main nodes in the whole Mesos cluster and control the control. Thirdly, the design of the PID controller is carried out. The load has the function of automatically adjusting the performance data through the PID control item, and the real-time data can be sent to the controller by the PCM data monitoring item, and the difference between the real data and the target data in the controller is obtained, and the mathematics is controlled by the PID control algorithm. The output value is obtained by the formula, and the allocation of caching resources is controlled according to the output value. In addition, the design of the Mysql database is also carried out, which makes the back end data and the front end parameters to be persistent and can store the data from the front and back programs. Fourthly, the design of the back end data visualization system is carried out and the work of the Web server is studied. By analyzing the visual requirements of the PID controller, selecting the appropriate Web server and using HTML and JavaScript language to develop the dynamic display of data, the control button, the parameter adjustment hurdles, the design of the load adding bar frame and the functional test. Functional testing and performance testing, including starting load, setting up the size of caching resources, back end data storage, front end data reading, dynamic display of data and other tests, selected a variety of LC loads and other loads to perform performance testing. Test results show that the system as a whole meets the requirements of the predetermined design.
【學位授予單位】：成都理工大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TP3
本文編號：2167892
[Abstract]:The improvement and application design of cloud computing resource scheduling method, aiming at the business characteristics and service mode of cloud computing at home and abroad, put forward higher requirements for high concurrency and high real-time online service mode in cloud computing service, and the traditional resource scheduling strategy only distributes the virtual computing, memory, storage and network resources. The LC (Latency Critical) load service delay is too long and the overall service quality of the platform is poor. Under this background, the new CAT (Cache Allocation Technology) technology is studied. The PID (Proportion Integration Differentiation) algorithm is used as the controller of the resource scheduling, which uses the WCP main board as the multi core. The platform of chip processor (CMPs), with the processor of Intel? Xeon? E5 series, is implemented on the basis of the Mesos resource scheduling system, and proposes a scheduling method for the caching resources in the multi core and multi chip environment, which makes up for the defects in the field of caching resources control, and its selection has a strong pertinence and practicability. Therefore, a study on Linux is made in this paper. Under the operating system, the Mesos resource scheduling system and the Marathon framework are used to build and simulate the Mesos cluster environment of a master node and two slave nodes. The load starting process, the resource allocation mode and the state monitoring function of the Marathon framework are tested. In further research, the WCP master and Intel Xeon E5 series processor are used in further research. As a hardware service platform, combined with Mesos, Marathon and Docker container technology, the PCM data monitoring module, PID control module, the front end parameter reading module, the back end data write module are designed in the Linux system using the C language, and the Mysql database is designed with the SQL language in the Linux system, including the front end parameter memory. The table structure of storage and back end data storage is built on this basis by using HTML and JavaScript language to design the back end data visualization system. Four kinds of back end data dynamic display, PID control switch, PID algorithm parameter configuration, load addition and extension function are designed. The research of this project promotes the technology of cloud computing resource scheduling. Development has a certain reference value. The research work of this paper is mainly embodied in the following aspects: first, it studies the current situation and latest achievements of cloud computing resource scheduling methods at home and abroad, and combines the limitations of traditional resource allocation methods, and carries out CAT cache allocation technology, PID automatic control algorithm, cloud computing resource scheduling technology, Doc The analysis of Ker container technology focuses on the principle and protocol standard of the automatic control module in the cloud computing resource scheduling method. Secondly, the related technologies of the Mesos resource scheduling system and the Marathon framework are studied. On the basis of the comparison and selection of the related platforms and software, the Linux Shell command is used in three Linux hosts. Install a Mesos master node, two Mesos slave nodes respectively, and install PID controller on each node, build a small Mesos cluster, use the Docker container technology to container the load, carry out the function test and performance test of the PID controller, so as to master the main nodes in the whole Mesos cluster and control the control. Thirdly, the design of the PID controller is carried out. The load has the function of automatically adjusting the performance data through the PID control item, and the real-time data can be sent to the controller by the PCM data monitoring item, and the difference between the real data and the target data in the controller is obtained, and the mathematics is controlled by the PID control algorithm. The output value is obtained by the formula, and the allocation of caching resources is controlled according to the output value. In addition, the design of the Mysql database is also carried out, which makes the back end data and the front end parameters to be persistent and can store the data from the front and back programs. Fourthly, the design of the back end data visualization system is carried out and the work of the Web server is studied. By analyzing the visual requirements of the PID controller, selecting the appropriate Web server and using HTML and JavaScript language to develop the dynamic display of data, the control button, the parameter adjustment hurdles, the design of the load adding bar frame and the functional test. Functional testing and performance testing, including starting load, setting up the size of caching resources, back end data storage, front end data reading, dynamic display of data and other tests, selected a variety of LC loads and other loads to perform performance testing. Test results show that the system as a whole meets the requirements of the predetermined design.
【學位授予單位】：成都理工大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TP3
【參考文獻】
相關期刊論文 前10條
1 張志超;彭蓉;黃華;;SaaS環(huán)境下基于服務質量的資源分配算法[J];計算機工程與設計;2015年08期
2 方曉平;陳年生;郭宇;李琦;周麗;;云計算資源分配策略研究[J];湖北師范學院學報(自然科學版);2013年04期
3 秦志光;柯濤;劉夢娟;王聰;;面向云平臺的資源分配策略研究[J];計算機應用;2013年02期
4 林偉偉;齊德昱;;云計算資源調度研究綜述[J];計算機科學;2012年10期
5 張峰;;云計算應用服務模式探討[J];信息技術與信息化;2012年02期
6 宋維佳;馬皓;肖臻;張曉軍;張蓓;;虛擬化數據中心資源調度研究[J];廣西大學學報(自然科學版);2011年S1期
7 黃大川;;云計算數據中心網絡的關鍵技術[J];郵電設計技術;2011年10期
8 羅軍舟;金嘉暉;宋愛波;東方;;云計算:體系架構與關鍵技術[J];通信學報;2011年07期
9 張耀祥;;云計算和虛擬化技術[J];計算機安全;2011年05期
10 陳全;鄧倩妮;;云計算及其關鍵技術[J];計算機應用;2009年09期
相關碩士學位論文 前2條
1 李小六;云計算數據中心資源管理研究[D];江南大學;2014年
2 吳吉紅;基于服務質量的多租戶資源調度方法研究[D];遼寧大學;2012年
，本文編號：2167892
本文鏈接：http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2167892.html
