分布式服務(wù)與服務(wù)集群技術(shù)研究
發(fā)布時(shí)間：2018-11-18 14:54
【摘要】：隨著互聯(lián)網(wǎng)技術(shù)的進(jìn)一步的發(fā)展與深入,越來越多的企業(yè)應(yīng)用需要應(yīng)對(duì)百萬級(jí)的高并發(fā)用戶訪問、低延時(shí)及7×24×365高可用性等空前的需求難題,應(yīng)用系統(tǒng)的業(yè)務(wù)訪問量與日俱增,對(duì)應(yīng)用服務(wù)器和數(shù)據(jù)庫的要求越來越高。在Web站點(diǎn)以及云平臺(tái)中存在大量半結(jié)構(gòu)化數(shù)據(jù),傳統(tǒng)的關(guān)系型數(shù)據(jù)庫難以適應(yīng)半結(jié)構(gòu)化的數(shù)據(jù)存儲(chǔ)訪問模式,例如用戶Session信息。在面臨大規(guī)模數(shù)據(jù)訪問時(shí),RAM與ROM在讀寫速度上相差數(shù)個(gè)數(shù)量級(jí),磁盤的IO操作會(huì)堆積RAM中的數(shù)據(jù)讀寫請(qǐng)求,造成性能瓶頸,從而導(dǎo)致越來越高的訪問響應(yīng)延遲。分布式緩存使用系統(tǒng)的高速內(nèi)存(RAM)作為數(shù)據(jù)對(duì)象的存儲(chǔ)介質(zhì),并采用鍵值對(duì)的形式存儲(chǔ)數(shù)據(jù)。這樣就可以在價(jià)格低廉、標(biāo)準(zhǔn)化的硬件和軟件平臺(tái)上的擴(kuò)展系統(tǒng)的內(nèi)存,專門用于緩存海量的數(shù)據(jù),為大容量、業(yè)務(wù)關(guān)鍵型的事務(wù)處理提供業(yè)務(wù)支撐。隨著業(yè)務(wù)需求的進(jìn)一步發(fā)展,應(yīng)用規(guī)模在不斷的擴(kuò)大,巨無霸應(yīng)用也就越來越多,傳統(tǒng)應(yīng)用的垂直架構(gòu),已經(jīng)無法應(yīng)對(duì)各種復(fù)雜業(yè)務(wù)帶來的各種挑戰(zhàn)。只有進(jìn)行業(yè)務(wù)梳理,將公共能力抽取成基礎(chǔ)服務(wù)或公共服務(wù),對(duì)復(fù)雜應(yīng)用進(jìn)行模塊化拆分和服務(wù)化治理,降低服務(wù)消費(fèi)者與服務(wù)提供者之間的耦合度。對(duì)采用了傳統(tǒng)的垂直架構(gòu)的系統(tǒng)應(yīng)用進(jìn)行服務(wù)治理化改造,將應(yīng)用的各個(gè)部分的業(yè)務(wù)進(jìn)行服務(wù)抽取和分離,形成一個(gè)個(gè)相對(duì)獨(dú)立的服務(wù)節(jié)點(diǎn),其中的每個(gè)服務(wù)節(jié)點(diǎn)只處理一件或多件相關(guān)的同類型的業(yè)務(wù),如單點(diǎn)登陸服務(wù)器,只處理用戶登陸相關(guān)的業(yè)務(wù)。應(yīng)對(duì)百萬級(jí)的并發(fā)訪問、每秒數(shù)千的并發(fā)事務(wù)處理時(shí),任何單個(gè)服務(wù)節(jié)點(diǎn)都不能做到及時(shí)響應(yīng)。這個(gè)時(shí)候,考慮的不是增加單個(gè)服務(wù)器的性能,而是需要對(duì)高訪問量、高并發(fā)量的服務(wù)節(jié)點(diǎn)架設(shè)一個(gè)或多個(gè)服務(wù)器集群分擔(dān)業(yè)務(wù)壓力,形成多臺(tái)服務(wù)器提供相同的服務(wù),并相互之間相互獨(dú)立的服務(wù)器集群,最終實(shí)現(xiàn)整個(gè)應(yīng)用的垂直架構(gòu)平滑地向分布式服務(wù)框架演變。本論文選題來自于本人曾經(jīng)實(shí)習(xí)的亞信科技有限公司的服務(wù)治理項(xiàng)目組,靈感來源于其對(duì)北京移動(dòng)CRM系統(tǒng)服務(wù)化改造的北京移動(dòng)能力開放平臺(tái)項(xiàng)目,能力開放平臺(tái)通過將業(yè)務(wù)支撐系統(tǒng)業(yè)務(wù)能力的逐步有序開放與管控,實(shí)現(xiàn)內(nèi)部業(yè)務(wù)能力對(duì)內(nèi)、外部渠道的共享以及開發(fā)者和運(yùn)營者的利益雙贏,使得電信業(yè)務(wù)開發(fā)變得更為容易和高效,促進(jìn)移動(dòng)互聯(lián)網(wǎng)業(yè)務(wù)的發(fā)展和繁榮,支持業(yè)務(wù)能力持續(xù)創(chuàng)新。本文旨在研究和探討,如何實(shí)現(xiàn)通過服務(wù)治理的方式將傳統(tǒng)應(yīng)用的垂直架構(gòu)方案演變成分布式服務(wù)架構(gòu)方案,以達(dá)到解耦服務(wù)提供方和服務(wù)使用方之間的耦合關(guān)系的目的,并通過分布式緩存、分布式服務(wù)、服務(wù)器集群、消息中間件、服務(wù)注冊(cè)中心、數(shù)據(jù)庫分庫分表、負(fù)載均衡、系統(tǒng)業(yè)務(wù)分拆等技術(shù)手段應(yīng)對(duì)高訪問量、高并發(fā)量、高可用等方面的應(yīng)用需求。
[Abstract]:With the further development and deepening of Internet technology, more and more enterprise applications need to deal with the unprecedented difficulties of high concurrent user access, low latency and 7 脳 24 脳 365 high availability, and the number of business visits to the application system is increasing day by day. Application servers and databases are increasingly demanding. There is a large amount of semi-structured data in Web sites and cloud platforms, and traditional relational databases are difficult to adapt to semi-structured data storage access patterns, such as user Session information. When faced with large-scale data access, RAM and ROM differ several orders of magnitude in read and write speed. The IO operation of disk will pile up data read and write requests in RAM, resulting in performance bottleneck, which leads to higher and higher access response delay. The distributed cache uses the high speed memory (RAM) of the system as the storage medium of the data object and stores the data in the form of key-value pairs. In this way, we can extend the memory of the system on the cheap, standardized hardware and software platform, specially used to cache the massive data, and provide the service support for the transaction processing of the large capacity and business critical type. With the further development of business requirements and the continuous expansion of application scale, there are more and more Big Mac applications. The vertical structure of traditional applications can no longer cope with various challenges brought by complex business. Only by combing the business, extracting the public capacity into basic services or public services, the complex applications are divided into modular and service-oriented governance, so as to reduce the coupling degree between service consumers and service providers. The system application with traditional vertical architecture is transformed into service governance, and the services of each part of the application are extracted and separated to form a relatively independent service node. Each service node only handles one or more related services, such as single-point login server, and only deals with user logon related services. For millions of concurrent access and thousands of concurrent transactions per second, no single service node can respond in a timely manner. At this time, the consideration is not to increase the performance of a single server, but to set up one or more server clusters with high traffic and high concurrency to share the business pressure, resulting in multiple servers providing the same service. Finally, the vertical architecture of the whole application evolves smoothly to the distributed service framework. The topic of this thesis comes from the service management project team of Asense Technology Co., Ltd., which I once worked as an intern. The inspiration comes from the Beijing Mobile open platform project for the service transformation of Beijing Mobile CRM system. The open platform realizes the sharing of internal and external channels and the interests of developers and operators through the gradual and orderly opening and control of the business capabilities of the business support system. It makes telecom service development easier and more efficient, promotes the development and prosperity of mobile Internet service, and supports continuous innovation of service capability. The purpose of this paper is to study and discuss how to transform the vertical architecture scheme of traditional application into a distributed service architecture scheme through service governance, in order to decouple the coupling relationship between service provider and service consumer. And through distributed cache, distributed services, server cluster, message middleware, service registry, database table, load balancing, system business separation and other technical means to deal with high traffic, high concurrency, etc. High availability and other application requirements.
【學(xué)位授予單位】：成都理工大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP393.092
本文編號(hào)：2340349
[Abstract]:With the further development and deepening of Internet technology, more and more enterprise applications need to deal with the unprecedented difficulties of high concurrent user access, low latency and 7 脳 24 脳 365 high availability, and the number of business visits to the application system is increasing day by day. Application servers and databases are increasingly demanding. There is a large amount of semi-structured data in Web sites and cloud platforms, and traditional relational databases are difficult to adapt to semi-structured data storage access patterns, such as user Session information. When faced with large-scale data access, RAM and ROM differ several orders of magnitude in read and write speed. The IO operation of disk will pile up data read and write requests in RAM, resulting in performance bottleneck, which leads to higher and higher access response delay. The distributed cache uses the high speed memory (RAM) of the system as the storage medium of the data object and stores the data in the form of key-value pairs. In this way, we can extend the memory of the system on the cheap, standardized hardware and software platform, specially used to cache the massive data, and provide the service support for the transaction processing of the large capacity and business critical type. With the further development of business requirements and the continuous expansion of application scale, there are more and more Big Mac applications. The vertical structure of traditional applications can no longer cope with various challenges brought by complex business. Only by combing the business, extracting the public capacity into basic services or public services, the complex applications are divided into modular and service-oriented governance, so as to reduce the coupling degree between service consumers and service providers. The system application with traditional vertical architecture is transformed into service governance, and the services of each part of the application are extracted and separated to form a relatively independent service node. Each service node only handles one or more related services, such as single-point login server, and only deals with user logon related services. For millions of concurrent access and thousands of concurrent transactions per second, no single service node can respond in a timely manner. At this time, the consideration is not to increase the performance of a single server, but to set up one or more server clusters with high traffic and high concurrency to share the business pressure, resulting in multiple servers providing the same service. Finally, the vertical architecture of the whole application evolves smoothly to the distributed service framework. The topic of this thesis comes from the service management project team of Asense Technology Co., Ltd., which I once worked as an intern. The inspiration comes from the Beijing Mobile open platform project for the service transformation of Beijing Mobile CRM system. The open platform realizes the sharing of internal and external channels and the interests of developers and operators through the gradual and orderly opening and control of the business capabilities of the business support system. It makes telecom service development easier and more efficient, promotes the development and prosperity of mobile Internet service, and supports continuous innovation of service capability. The purpose of this paper is to study and discuss how to transform the vertical architecture scheme of traditional application into a distributed service architecture scheme through service governance, in order to decouple the coupling relationship between service provider and service consumer. And through distributed cache, distributed services, server cluster, message middleware, service registry, database table, load balancing, system business separation and other technical means to deal with high traffic, high concurrency, etc. High availability and other application requirements.
【學(xué)位授予單位】：成都理工大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP393.092
【參考文獻(xiàn)】
相關(guān)博士學(xué)位論文 前2條
1 王紅斌;Web服務(wù)器集群系統(tǒng)的自適應(yīng)負(fù)載均衡調(diào)度策略研究[D];吉林大學(xué);2013年
2 盧本捷;分布式消息隊(duì)列的理論、實(shí)現(xiàn)與應(yīng)用[D];華中科技大學(xué);2004年
相關(guān)碩士學(xué)位論文 前10條
1 張羽;一種分布式服務(wù)治理框架的設(shè)計(jì)與實(shí)現(xiàn)[D];北京交通大學(xué);2016年
2 劉先紡;基于Dubbo的網(wǎng)上訂餐系統(tǒng)[D];華南理工大學(xué);2016年
3 張永祥;電子商務(wù)系統(tǒng)平臺(tái)模型的研究與實(shí)現(xiàn)[D];電子科技大學(xué);2016年
4 馮博;基于PaaS的電信虛擬運(yùn)營商系統(tǒng)設(shè)計(jì)和實(shí)現(xiàn)[D];中國科學(xué)院大學(xué)(工程管理與信息技術(shù)學(xué)院);2015年
5 王利萍;基于Nginx服務(wù)器集群負(fù)載均衡技術(shù)的研究與改進(jìn)[D];山東大學(xué);2015年
6 侯yN寒;電信能力開放平臺(tái)中鑒權(quán)框架的設(shè)計(jì)與實(shí)現(xiàn)[D];北京郵電大學(xué);2015年
7 崔解賓;分布式內(nèi)存緩存技術(shù)在數(shù)據(jù)處理平臺(tái)中的研究與應(yīng)用[D];北京郵電大學(xué);2015年
8 閆明;高可用可擴(kuò)展集群化Redis設(shè)計(jì)與實(shí)現(xiàn)[D];西安電子科技大學(xué);2014年
9 沈偉;云計(jì)算平臺(tái)下分布式緩存系統(tǒng)的性能優(yōu)化研究[D];西安電子科技大學(xué);2014年
10 吳偉華;基于分布式緩存的內(nèi)容分發(fā)網(wǎng)絡(luò)[D];西安電子科技大學(xué);2014年
，本文編號(hào)：2340349
本文鏈接：http://sikaile.net/guanlilunwen/ydhl/2340349.html
最近更新
教材專著
