本文關(guān)鍵詞： 消息中間件 消息持久化 分布式存儲 Memcached 文件存儲　出處：《浙江大學》2012年碩士論文　論文類型：學位論文

【摘要】：金融領(lǐng)域中存在著眾多復雜的、分布式的、異構(gòu)的應用系統(tǒng)。這些應用系統(tǒng)之間存在著大量的業(yè)務(wù)數(shù)據(jù)交互需求。國內(nèi)金融行業(yè)某交易中心為了使證券交易數(shù)據(jù)能夠異步地、可靠地、安全地傳遞給各家交易機構(gòu)的應用系統(tǒng),采用消息中間件MessageHub作為可靠的消息傳遞手段。持久化存儲系統(tǒng)是該消息中間件的重要模塊,它的實現(xiàn)技術(shù)對消息中間件的功能和性能影響很大。 MessageHub現(xiàn)有的持久化系統(tǒng)在擴展性和健壯性等方面存在一些缺點,不能很好地滿足該應用場景的需要。為了解決這些問題,本文對消息中間件及其消息持久化技術(shù)進行了分析與研究,借鑒分布式存儲的相關(guān)技術(shù),結(jié)合MessageHub對數(shù)據(jù)存儲的需求和特點,設(shè)計了一個可靠性高、易擴展、高可用、高性能的,面向證券交易數(shù)據(jù)傳輸?shù)南⒅虚g件的持久化存儲系統(tǒng),并通過精心的設(shè)計,使其滿足該場景對消息一致性的需要。 論文詳細介紹了存儲系統(tǒng)的架構(gòu)和各個模塊的具體設(shè)計。存儲系統(tǒng)的整體設(shè)計借鑒了Memcached這個分布式緩存系統(tǒng),由客戶端組件和服務(wù)端組件兩部分組成。為了提高存儲的可靠性,存儲系統(tǒng)對數(shù)據(jù)進行雙備份,并結(jié)合一致性哈希算法和虛擬節(jié)點技術(shù),實現(xiàn)數(shù)據(jù)在存儲節(jié)點的均衡分布。系統(tǒng)對已發(fā)送消息的隊列store采用主動復制方式,而對待發(fā)送消息的隊列queue采用被動復制方式,以滿足它們對一致性不同的需要。系統(tǒng)通過監(jiān)聽器機制支持存儲節(jié)點的動態(tài)變化。由于MessageHub傳輸?shù)南⒘看?存儲系統(tǒng)采用基于文件存儲的持久化方法,分別對store和queue設(shè)計了各自的存儲方法和持久化流程�；谝陨涎芯亢蛣�(chuàng)新設(shè)計,本文實現(xiàn)了存儲系統(tǒng)的原型系統(tǒng),驗證了該系統(tǒng)的可行性,并在模擬環(huán)境下進行了相關(guān)的測試。測試表明,該系統(tǒng)可靠高效,具有較好的性能和擴展性。
[Abstract]:There are many complex, distributed and heterogeneous applications in the field of finance. There are a lot of business data interaction requirements among these applications. The message middleware (MessageHub) is used as the reliable means of message delivery in the application system which is passed to each trading organization reliably and safely. The persistent storage system is the important module of the message middleware. Its implementation technology has great influence on the function and performance of message middleware. The existing persistence system of MessageHub has some shortcomings in scalability and robustness, which can not meet the needs of the application scenario. In this paper, the message middleware and message persistence technology are analyzed and studied. By referring to the related technology of distributed storage and combining the demand and characteristics of MessageHub for data storage, a high reliability, easy to extend, high availability and high performance is designed. The persistence storage system of message middleware for data transmission of securities exchange is designed carefully to meet the need of message consistency in this scenario. This paper introduces the architecture of the storage system and the design of each module in detail. The overall design of the storage system is based on the Memcached, a distributed cache system. In order to improve the reliability of storage, the storage system makes double backup of data, and combines the consistent hash algorithm and virtual node technology. To realize the balanced distribution of data in the storage node, the system adopts the active replication mode for the queue store of the sent message, while the passive replication method is used for the queue queue that sends the message. The system supports the dynamic change of storage nodes through the listener mechanism. Because of the large amount of messages transmitted by MessageHub, the storage system adopts the method of persistence based on file storage. The storage methods and persistence processes of store and queue are designed respectively. Based on the above research and innovative design, the prototype system of storage system is implemented in this paper, and the feasibility of the system is verified. The test results show that the system is reliable, efficient, and has good performance and expansibility.
【學位授予單位】：浙江大學
【學位級別】：碩士
【學位授予年份】：2012
【分類號】：TP333

【參考文獻】

相關(guān)期刊論文 前2條

1 徐晶,許煒;消息中間件綜述[J];計算機工程;2005年16期

2 李文逍;楊小虎;;基于分布式緩存的消息中間件存儲模型[J];計算機工程;2010年13期

相關(guān)博士學位論文 前1條

1 魏青松;大規(guī)模分布式存儲技術(shù)研究[D];電子科技大學;2004年

相關(guān)碩士學位論文 前2條

1 陳心亮;消息隊列存儲系統(tǒng)設(shè)計與實現(xiàn)[D];中國科學院研究生院（軟件研究所）;2002年

2 王宏斌;消息中間件技術(shù)的研究和實踐[D];浙江大學;2004年

，

本文編號：1530501