基于IVCE平臺的消息分發(fā)研究
發(fā)布時間：2018-08-28 10:06
【摘要】：本論文主要解決IVCE感知云平臺各個子系統(tǒng)間的消息通信需求。原IVCE感知云平臺消息分發(fā)與業(yè)務(wù)邏輯耦合,由于業(yè)務(wù)的變化,業(yè)務(wù)邏輯需要頻繁的更新,當(dāng)耦合的一方或多方的消息通信模塊發(fā)生變化,耦合的其他成員也需要做出改變,這改變了系統(tǒng)原有的穩(wěn)定性和可靠性,開發(fā)成本較大。即使某類消息通信模塊成功完成,但是這種成功并不能有效復(fù)用,當(dāng)有新的種類的虛擬資源、新的網(wǎng)絡(luò)探測任務(wù)接入時,可能又會出現(xiàn)新的問題。而且消息轉(zhuǎn)發(fā)分散,沒有統(tǒng)一有效的手段監(jiān)控云平臺的健康狀態(tài),及時發(fā)現(xiàn)問題。而本論文所實現(xiàn)的消息分發(fā)系統(tǒng)解決了上述問題。首先對IVCE感知云平臺各個虛擬資源節(jié)點和服務(wù)節(jié)點的消息分發(fā)中存在問題進(jìn)行了研究,通過定性的分析指定定量的目標(biāo),完成消息分發(fā)系統(tǒng)的場景分析,確定了消息分發(fā)效率從原來的千條每秒提升到萬條每秒的可執(zhí)行目標(biāo)。研究分布式系統(tǒng)相關(guān)理論,學(xué)習(xí)優(yōu)秀的分布式系統(tǒng)開源技術(shù),并成功運(yùn)用到本論文系統(tǒng)的實現(xiàn)中。消息分發(fā)系統(tǒng)應(yīng)對的是每日百萬條消息的場景,單個節(jié)點的消息分發(fā)系統(tǒng)很難應(yīng)對如此高并發(fā)的訪問,所以消息分發(fā)系統(tǒng)設(shè)計成了一個分布式系統(tǒng)。通過物理上分散的計算節(jié)點間協(xié)調(diào)合作,實現(xiàn)消息的高效分發(fā);計算節(jié)點間互為備份,實現(xiàn)數(shù)據(jù)冗余,容忍部分節(jié)點故障;在IVCE感知云平臺的場景下,權(quán)衡數(shù)據(jù)冗余和數(shù)據(jù)一致性的矛盾問題,充分提升消息分發(fā)系統(tǒng)的效率。建立基礎(chǔ)消息分發(fā)服務(wù)。研究和學(xué)習(xí)現(xiàn)有系統(tǒng)中,消息分發(fā)模型,選擇合適的消息分發(fā)方式應(yīng)用在本系統(tǒng)中,將消息分發(fā)功能通過分布式的方式實現(xiàn)。研究和學(xué)習(xí)操作系統(tǒng)支持的10技術(shù),高效的轉(zhuǎn)發(fā)消息。分析消息分發(fā)服務(wù)可能出現(xiàn)的異常點,并在模塊設(shè)計和實現(xiàn)中,做出相應(yīng)的應(yīng)對策略。在消息分發(fā)服務(wù)的基礎(chǔ)上,建立基于消息的監(jiān)控模塊,提升系統(tǒng)的維護(hù)效率。消息分發(fā)系統(tǒng)成為IVCE感知云平臺的消息分發(fā)中心后,通過分析平臺中各個系統(tǒng)間消息交互的頻繁程度,間接獲取到平臺其它子系統(tǒng)的運(yùn)行狀態(tài),發(fā)現(xiàn)IVCE感知云平臺的瓶頸,定位故障節(jié)點等。有效的把握平臺的運(yùn)行情況,切實保證了 IVCE感知云平臺的各項業(yè)務(wù)正常運(yùn)行。最后利用IVCE感知云平臺中現(xiàn)有的任務(wù),測試消息分發(fā)系統(tǒng)的效率、負(fù)載均衡、監(jiān)控和斷流機(jī)制,證實本文設(shè)計的消息分發(fā)系統(tǒng)能達(dá)到預(yù)定目標(biāo)。通過對消息系統(tǒng)的整體設(shè)計思路的研究,再具體細(xì)化到各個部分,包括存儲,緩存,遠(yuǎn)程調(diào)用,質(zhì)量保證,數(shù)據(jù)一致性,順序性,冪等性,高可用性等的綜合考慮,再到測試方法和測試方案的制定,提出了一種能應(yīng)對復(fù)雜的基礎(chǔ)設(shè)備和異構(gòu)網(wǎng)絡(luò),高效安全傳遞和分發(fā)消息,并能在一定程度上解耦交互的消息分發(fā)系統(tǒng)。通過消息數(shù)據(jù)評估整個系統(tǒng)的運(yùn)行狀態(tài)的消息分發(fā)系統(tǒng),為虛擬計算平臺的建設(shè)提供基本技術(shù)支撐。
[Abstract]:This paper mainly addresses the message communication requirement between the subsystems of IVCE aware cloud platform. The original IVCE is aware of the coupling of message distribution and business logic in cloud platform. Due to the change of service, the business logic needs to be updated frequently. When the message communication module of one or more of the coupled parties changes, the other members of the coupling also need to make changes. This changes the original stability and reliability of the system, and the development cost is high. Even if a certain kind of message communication module is successfully completed, this kind of success can not be reused effectively. When there are new kinds of virtual resources and new network detection task access, there may be new problems. Moreover, message forwarding is dispersed, there is no unified and effective means to monitor the health status of cloud platform, and problems can be found in time. The message distribution system implemented in this paper solves the above problems. First of all, the problems in message distribution of each virtual resource node and service node of IVCE aware cloud platform are studied, and the scene analysis of message distribution system is completed by qualitative analysis, which specifies the quantitative target and completes the scene analysis of the message distribution system. The executable target of message distribution efficiency is determined from the original thousand per second to ten thousand per second. This paper studies the relevant theories of distributed system, studies the excellent open source technology of distributed system, and successfully applies it to the implementation of this paper. The message distribution system is designed as a distributed system because it is difficult for a single node's message distribution system to cope with such high concurrent access because it is dealing with a scenario of millions of messages per day. Through the coordination and cooperation between the distributed computing nodes, the efficient distribution of messages is realized; the computing nodes are backed up each other, data redundancy is realized, and some node failures are tolerated. In the scenario of IVCE aware cloud platform, Balancing the contradiction between data redundancy and data consistency can improve the efficiency of message distribution system. Establish the basic message distribution service. This paper studies and studies the message distribution model in the existing system, selects the appropriate message distribution mode to be applied in this system, and implements the message distribution function in a distributed way. Research and study 10 technologies supported by the operating system to forward messages efficiently. The possible outliers of message distribution service are analyzed, and the corresponding countermeasures are made in the design and implementation of the module. On the basis of message distribution service, a message-based monitoring module is established to improve the maintenance efficiency of the system. After the message distribution system becomes the message distribution center of the IVCE aware cloud platform, by analyzing the frequent degree of message interaction among the different systems in the platform, the running state of other subsystems of the platform is obtained indirectly, and the bottleneck of the IVCE aware cloud platform is found. Locate fault nodes, etc. Effectively grasp the operation of the platform, effectively ensure that the IVCE cloud aware of the normal operation of the platform. Finally, using IVCE aware of the existing tasks in the cloud platform, testing the efficiency, load balancing, monitoring and disconnection mechanism of the message distribution system, it is proved that the message distribution system designed in this paper can achieve the predetermined goal. Through the study of the overall design of the message system, it is further detailed into various parts, including the comprehensive consideration of storage, cache, remote call, quality assurance, data consistency, order, idempotent, high availability, etc. Then, the test method and test scheme are formulated, and a message distribution system is proposed, which can deal with complex infrastructure and heterogeneous network, deliver and distribute messages efficiently and safely, and decouple and interact to a certain extent. The message distribution system which evaluates the running state of the whole system through message data provides the basic technical support for the construction of the virtual computing platform.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP393.09
本文編號：2209070
[Abstract]:This paper mainly addresses the message communication requirement between the subsystems of IVCE aware cloud platform. The original IVCE is aware of the coupling of message distribution and business logic in cloud platform. Due to the change of service, the business logic needs to be updated frequently. When the message communication module of one or more of the coupled parties changes, the other members of the coupling also need to make changes. This changes the original stability and reliability of the system, and the development cost is high. Even if a certain kind of message communication module is successfully completed, this kind of success can not be reused effectively. When there are new kinds of virtual resources and new network detection task access, there may be new problems. Moreover, message forwarding is dispersed, there is no unified and effective means to monitor the health status of cloud platform, and problems can be found in time. The message distribution system implemented in this paper solves the above problems. First of all, the problems in message distribution of each virtual resource node and service node of IVCE aware cloud platform are studied, and the scene analysis of message distribution system is completed by qualitative analysis, which specifies the quantitative target and completes the scene analysis of the message distribution system. The executable target of message distribution efficiency is determined from the original thousand per second to ten thousand per second. This paper studies the relevant theories of distributed system, studies the excellent open source technology of distributed system, and successfully applies it to the implementation of this paper. The message distribution system is designed as a distributed system because it is difficult for a single node's message distribution system to cope with such high concurrent access because it is dealing with a scenario of millions of messages per day. Through the coordination and cooperation between the distributed computing nodes, the efficient distribution of messages is realized; the computing nodes are backed up each other, data redundancy is realized, and some node failures are tolerated. In the scenario of IVCE aware cloud platform, Balancing the contradiction between data redundancy and data consistency can improve the efficiency of message distribution system. Establish the basic message distribution service. This paper studies and studies the message distribution model in the existing system, selects the appropriate message distribution mode to be applied in this system, and implements the message distribution function in a distributed way. Research and study 10 technologies supported by the operating system to forward messages efficiently. The possible outliers of message distribution service are analyzed, and the corresponding countermeasures are made in the design and implementation of the module. On the basis of message distribution service, a message-based monitoring module is established to improve the maintenance efficiency of the system. After the message distribution system becomes the message distribution center of the IVCE aware cloud platform, by analyzing the frequent degree of message interaction among the different systems in the platform, the running state of other subsystems of the platform is obtained indirectly, and the bottleneck of the IVCE aware cloud platform is found. Locate fault nodes, etc. Effectively grasp the operation of the platform, effectively ensure that the IVCE cloud aware of the normal operation of the platform. Finally, using IVCE aware of the existing tasks in the cloud platform, testing the efficiency, load balancing, monitoring and disconnection mechanism of the message distribution system, it is proved that the message distribution system designed in this paper can achieve the predetermined goal. Through the study of the overall design of the message system, it is further detailed into various parts, including the comprehensive consideration of storage, cache, remote call, quality assurance, data consistency, order, idempotent, high availability, etc. Then, the test method and test scheme are formulated, and a message distribution system is proposed, which can deal with complex infrastructure and heterogeneous network, deliver and distribute messages efficiently and safely, and decouple and interact to a certain extent. The message distribution system which evaluates the running state of the whole system through message data provides the basic technical support for the construction of the virtual computing platform.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP393.09
【參考文獻(xiàn)】
相關(guān)期刊論文 前3條
1 唐海東;武延軍;;分布式同步系統(tǒng)Zookeeper的優(yōu)化[J];計算機(jī)工程;2014年04期
2 胡澤;廖聞劍;彭艷兵;;WebService技術(shù)研究及應(yīng)用[J];硅谷;2009年05期
3 石偉鵬,楊小虎;基于SOAP協(xié)議的Web Service安全基礎(chǔ)規(guī)范(WS-Security)[J];計算機(jī)應(yīng)用研究;2003年02期
，本文編號：2209070
本文鏈接：http://sikaile.net/guanlilunwen/ydhl/2209070.html
最近更新
教材專著
