天堂国产午夜亚洲专区-少妇人妻综合久久蜜臀-国产成人户外露出视频在线-国产91传媒一区二区三区

面向數(shù)據(jù)中心的RDMA高速網(wǎng)絡(luò)服務(wù)通用平臺(tái)

發(fā)布時(shí)間:2018-07-20 19:50
【摘要】:網(wǎng)絡(luò)I/O一直是分布式應(yīng)用的瓶頸。為此,相關(guān)研究者提出高速網(wǎng)絡(luò)RDMA(Remote Direct Memory Access)技術(shù)。RDMA具有卸載TCP/IP協(xié)議棧和用戶態(tài)下處理數(shù)據(jù)傳輸?shù)墓ぷ鞣绞?它首先在高性能計(jì)算領(lǐng)域得到廣泛應(yīng)用。隨著其硬件價(jià)格的降低和RDMA over Ethernet的出現(xiàn),數(shù)據(jù)中心也將RDMA引入。它的低延遲、高帶寬、CPU輕負(fù)荷的特點(diǎn),為許多傳統(tǒng)分布式應(yīng)用的設(shè)計(jì)提供了新思路,也對(duì)新興的大數(shù)據(jù)處理、云計(jì)算服務(wù)等起到性能保障,F(xiàn)有的利用RDMA技術(shù)加速分布式系統(tǒng)的工作都是將RDMA網(wǎng)絡(luò)模塊與整個(gè)系統(tǒng)緊耦合。系統(tǒng)設(shè)計(jì)者通常以一個(gè)高速網(wǎng)絡(luò)模塊的角度來使用RDMA,試圖來解決跨節(jié)點(diǎn)間的數(shù)據(jù)傳輸瓶頸。當(dāng)將這些系統(tǒng)部署到數(shù)據(jù)中心或者云計(jì)算環(huán)境下,就會(huì)產(chǎn)生資源浪費(fèi)、惡性競(jìng)爭、較差的數(shù)據(jù)本地性、可擴(kuò)展性不夠等問題。此外,將RDMA網(wǎng)絡(luò)模塊與特定系統(tǒng)緊耦合這種方式,不但增加系統(tǒng)設(shè)計(jì)者的負(fù)擔(dān),還在系統(tǒng)維護(hù)成本、軟件復(fù)用、大規(guī)模部署等方面有所損害;谏鲜鲈,我們?cè)O(shè)計(jì)并實(shí)現(xiàn)一個(gè)提供RDMA高速網(wǎng)絡(luò)的通用平臺(tái)RDMAVisor,以守護(hù)進(jìn)程的方式存在,向應(yīng)用程序提供簡單易用的接口來調(diào)用RDMA高速網(wǎng)絡(luò)服務(wù)。分布式應(yīng)用設(shè)計(jì)者通過這些接口,來獲得類似于系統(tǒng)服務(wù)一樣的RDMA高速網(wǎng)絡(luò)數(shù)據(jù)傳輸服務(wù),從而能夠?qū)P挠趹?yīng)用邏輯的設(shè)計(jì)和實(shí)現(xiàn)。本文的主要貢獻(xiàn)有以下4點(diǎn):(1)設(shè)計(jì)并實(shí)現(xiàn)面向數(shù)據(jù)中心的RDMA網(wǎng)絡(luò)服務(wù)通用平臺(tái)RDMAVisor;(2)對(duì)RDMA中各種服務(wù)類型和操作進(jìn)行分析,以自適應(yīng)調(diào)節(jié)參數(shù)的方式,為各種類型的分布式應(yīng)用提供用戶態(tài)下的數(shù)據(jù)傳輸服務(wù);(3)通過復(fù)用RDMA連接實(shí)體,減輕甚至解決了RDMA的可擴(kuò)展性問題;(4)針對(duì)RDMA原生操作如RDMA Remote Atomic的不足,RDMAVisor在守護(hù)進(jìn)程層級(jí)向用戶提供Remote Atomic操作,以更高效的方式替換掉RDMA原生操作。
[Abstract]:Network I / O has been the bottleneck of distributed applications. For this reason, researchers have proposed that the high-speed network RDMA (remote Direct memory Access) technology. RDMA has the ability to uninstall TCP / IP protocol stack and process data transmission in user state. It is widely used in the field of high performance computing. With the reduction of hardware price and the emergence of RDMA over Ethernet, the data center also introduces RDMA. Its characteristics of low latency and high bandwidth and low CPU load provide new ideas for the design of many traditional distributed applications, and also guarantee the performance of the emerging big data processing, cloud computing services and so on. The existing work of using RDMA technology to accelerate the distributed system is to tightly couple the RDMA network module with the whole system. System designers usually use RDMAs as a high-speed network module to try to solve the bottleneck of data transmission between nodes. When these systems are deployed in the data center or cloud computing environment, there will be problems such as waste of resources, vicious competition, poor data locality, poor scalability and so on. In addition, the tight coupling of RDMA network modules with specific systems not only increases the burden on system designers, but also damages system maintenance costs, software reuse, large-scale deployment, and so on. For the above reasons, we design and implement a general platform for RDMA high-speed network, RDMA Visor, which exists as a daemon and provides an easy to use interface to the application program to invoke the RDMA high-speed network service. Through these interfaces, distributed application designers can obtain RDMA high-speed network data transmission services similar to system services, so that they can concentrate on the design and implementation of application logic. The main contributions of this paper are as follows: (1) designing and implementing the general platform of RDMA network service for data center, (2) analyzing various service types and operations in RDMA, and adjusting the parameters adaptively. Provide data transmission services for various types of distributed applications in user mode; (3) by multiplexing RDMA connection entities, The extensibility of RDMA is alleviated or even solved. (4) RDMA native operations such as RDMA remote Atomic are not suitable for RDMA. RDMA Visor provides remote Atomic operations to users at the daemon level and replaces them with more efficient methods.
【學(xué)位授予單位】:南京大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2017
【分類號(hào)】:TP393.0

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 劉翔;羅菊;車軍;;下一代傳輸網(wǎng)絡(luò)通用平臺(tái)[J];中國新通信;2007年05期

2 任東旺,田文德,姚飛;一種管理信息系統(tǒng)通用平臺(tái)思想的提出[J];微型電腦應(yīng)用;2003年03期

3 陳建;李劍峰;李方義;王玉玲;姜峰;馬開\,

本文編號(hào):2134589


資料下載
論文發(fā)表

本文鏈接:http://sikaile.net/guanlilunwen/ydhl/2134589.html


Copyright(c)文論論文網(wǎng)All Rights Reserved | 網(wǎng)站地圖 |

版權(quán)申明:資料由用戶77c08***提供,本站僅收錄摘要或目錄,作者需要?jiǎng)h除請(qǐng)E-mail郵箱bigeng88@qq.com