基于MPI的高并發(fā)負(fù)載生成系統(tǒng)的研究與實(shí)現(xiàn)
發(fā)布時(shí)間:2018-05-22 17:14
本文選題:高并發(fā)負(fù)載生成 + 壓力測試系統(tǒng) ; 參考:《中山大學(xué)》2014年碩士論文
【摘要】:壓力測試是檢驗(yàn)Web應(yīng)用QOS(Quality of Service)的一種重要方法,測試所需的高并發(fā)請(qǐng)求需要借助計(jì)算機(jī)程序來生成。隨著云計(jì)算時(shí)代的到來,后端服務(wù)器的性能得到空前的提升,傳統(tǒng)的負(fù)載生成方案已經(jīng)越來越不能滿足現(xiàn)代云端服務(wù)器壓力測試的需求。 已有的負(fù)載生成方案中,多線程負(fù)載生成法由于技術(shù)成熟且穩(wěn)定性好,被大多數(shù)商業(yè)和開源系統(tǒng)所采用。然而這種每個(gè)線程管理一個(gè)連接的方式在并發(fā)連接數(shù)很高時(shí),會(huì)因?yàn)轭l繁的線程上下文切換而導(dǎo)致性能急劇惡化。另一類基于異步I/O的負(fù)載生成方法雖然能夠高效地產(chǎn)生大量負(fù)載,但是這種方案通常只使用了單個(gè)線程處理所有連接而沒能充分發(fā)揮多核CPU的處理能力。使用多核優(yōu)化異步I/O負(fù)載生成的設(shè)想雖然已經(jīng)存在,,但是缺少完整的工程實(shí)踐和有效性證明。另一方面,現(xiàn)代壓力測試系統(tǒng)的垂直擴(kuò)展能力的重要性也與日俱增,如何提高系統(tǒng)的可擴(kuò)展性也是當(dāng)前該領(lǐng)域研究的重要課題。 本文首先梳理了前人工作中與壓力測試系統(tǒng)以及負(fù)載生成系統(tǒng)相關(guān)的研究,分析總結(jié)了已有解決方案的基本原理以及研究結(jié)論,歸納出已有的工作中存在的不足以及缺陷。在這樣的基礎(chǔ)和背景下,本文提出了基于MPI技術(shù)的負(fù)載生成系統(tǒng)PBench的設(shè)計(jì)和實(shí)現(xiàn)。PBench在使用事件驅(qū)動(dòng)式的異步I/O負(fù)載生成技術(shù)的基礎(chǔ)上,利用MPI并行處理技術(shù)在多核以及分布式環(huán)境下實(shí)現(xiàn)任務(wù)級(jí)并行。充分發(fā)揮多核CPU的性能,提高單個(gè)計(jì)算節(jié)點(diǎn)負(fù)載生成的能力,同時(shí)也使得系統(tǒng)具備了很強(qiáng)的垂直擴(kuò)展能力,能夠方便地實(shí)現(xiàn)集群化。本文詳細(xì)地介紹了PBench的設(shè)計(jì)思想以及所用到的關(guān)鍵技術(shù),講述了PBench的設(shè)計(jì)要點(diǎn)和實(shí)現(xiàn)方式,并通過詳盡的實(shí)驗(yàn)來證明PBench這種并行化設(shè)計(jì)確實(shí)能夠充分發(fā)揮多核CPU的處理能力,提高單機(jī)負(fù)載生成的效率。
[Abstract]:Stress testing is an important method to test Web application QOS(Quality of Service. The high concurrency request for testing needs to be generated by computer program. With the arrival of cloud computing era, the performance of back-end servers has been improved unprecedented, the traditional load generation scheme has become more and more unable to meet the needs of modern cloud server stress testing. Among the existing load generation schemes, multithreaded load generation method has been adopted by most commercial and open source systems because of its mature technology and good stability. However, when the number of concurrent connections is high, the performance of each thread managed by one connection can deteriorate sharply because of frequent thread context switching. The other kind of load generation method based on asynchronous I / O can efficiently generate a large amount of load, but this scheme usually only uses a single thread to handle all connections without fully exerting the processing power of multi-core CPU. Although the idea of multi-core optimization for asynchronous I / O load generation is already in existence, there is a lack of complete engineering practice and validation. On the other hand, the vertical expansion ability of modern stress test system is becoming more and more important, and how to improve the scalability of the system is also an important topic in this field. In this paper, the previous researches related to the stress test system and the load generation system are reviewed, the basic principles and conclusions of the existing solutions are analyzed and summarized, and the shortcomings and defects in the existing work are summed up. On this basis and background, this paper presents the design and implementation of PBench, a load generation system based on MPI technology, based on the use of event-driven asynchronous I / O load generation technology. Task-level parallelism is implemented in multi-core and distributed environments using MPI parallel processing technology. The performance of multi-core CPU is brought into full play to improve the load generation ability of a single computing node. At the same time the system has a strong vertical expansion ability and can easily realize clustering. This paper introduces the design idea and key technology of PBench in detail, describes the key points and implementation methods of PBench, and proves that the parallel design of PBench can give full play to the processing ability of multi-core CPU through detailed experiments. Improve the efficiency of single machine load generation.
【學(xué)位授予單位】:中山大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2014
【分類號(hào)】:TP393.09
【參考文獻(xiàn)】
相關(guān)期刊論文 前6條
1 許之,唐曉華,盧顯良;網(wǎng)絡(luò)負(fù)載生成器的研究與設(shè)計(jì)[J];電子科技大學(xué)學(xué)報(bào);2005年05期
2 洪以容,孫德文;Web服務(wù)器性能測量工具webperf[J];計(jì)算機(jī)工程;2001年02期
3 黃冬泉;徐振亞;尹寶林;李偉琴;張敏;;Web服務(wù)器的過載模擬和性能測量[J];計(jì)算機(jī)工程與科學(xué);2007年02期
4 李怡;周國祥;;基于LoadRunner的一種性能測試流程方案研究與設(shè)計(jì)[J];計(jì)算機(jī)應(yīng)用研究;2009年11期
5 張廣艷,鄭名揚(yáng),鞠九濱;WebMark:一個(gè)Web服務(wù)器性能測試工具[J];軟件學(xué)報(bào);2003年07期
6 楊萍;李杰;;利用LoadRunner實(shí)現(xiàn)Web負(fù)載測試的自動(dòng)化[J];計(jì)算機(jī)技術(shù)與發(fā)展;2007年01期
本文編號(hào):1922935
本文鏈接:http://sikaile.net/guanlilunwen/ydhl/1922935.html
最近更新
教材專著