面向高性能計(jì)算環(huán)境的作業(yè)優(yōu)化調(diào)度模型的設(shè)計(jì)與實(shí)現(xiàn)
發(fā)布時(shí)間:2018-12-19 20:23
【摘要】:高性能計(jì)算環(huán)境聚合了多個(gè)分布在不同地域、不同組織機(jī)構(gòu)的高性能計(jì)算資源,面向用戶提供統(tǒng)一的訪問(wèn)入口和使用方式,由系統(tǒng)中間件根據(jù)用戶作業(yè)請(qǐng)求匹配合適的高性能計(jì)算資源。隨著環(huán)境應(yīng)用編程接口的開放以及作業(yè)請(qǐng)求數(shù)量的大幅增加,面對(duì)高并發(fā)作業(yè)提交請(qǐng)求時(shí),目前采用的即時(shí)調(diào)度模型會(huì)由于網(wǎng)絡(luò)等原因?qū)е乱欢〝?shù)量的請(qǐng)求處理失敗,同時(shí)缺乏靈活性。針對(duì)此問(wèn)題,優(yōu)化了環(huán)境作業(yè)調(diào)度模型,引入作業(yè)環(huán)境隊(duì)列,細(xì)化了作業(yè)系統(tǒng)層狀態(tài),增加了作業(yè)調(diào)度策略可配置性,并基于環(huán)境中間件SCE實(shí)現(xiàn)了系統(tǒng)原型。經(jīng)測(cè)試,在單核心服務(wù)每分鐘處理近200個(gè)作業(yè)提交請(qǐng)求的工作負(fù)載下,無(wú)因系統(tǒng)和網(wǎng)絡(luò)原因引起的作業(yè)提交出錯(cuò)現(xiàn)象;在共計(jì)1 000個(gè)作業(yè)中,近500個(gè)作業(yè)提交命令請(qǐng)求在0.3s以內(nèi)完成,800余個(gè)作業(yè)提交命令請(qǐng)求在0.5s以內(nèi)完成。
[Abstract]:The high performance computing environment aggregates many high performance computing resources distributed in different regions and different organizations, and provides users with uniform access and usage methods. The system middleware matches the appropriate high performance computing resources according to the user's job request. With the opening of the environment application programming interface and the large increase of the number of job requests, when the high concurrent jobs submit requests, the current instant scheduling model will lead to a certain number of requests processing failure due to network and other reasons. At the same time, lack of flexibility. Aiming at this problem, the environment job scheduling model is optimized, the job environment queue is introduced, the state of the job system layer is refined, the job scheduling policy is configurable, and the prototype of the system is implemented based on the environment middleware SCE. After testing, under the workload of processing nearly 200 job submission requests per minute by single core service, there is no error phenomenon caused by system and network reasons. Of the 1 000 jobs, nearly 500 job requests are completed within 0.3 s, and more than 800 job submission requests are completed within 0.5 s.
【作者單位】: 中國(guó)科學(xué)院計(jì)算機(jī)網(wǎng)絡(luò)信息中心;
【基金】:國(guó)家重點(diǎn)研發(fā)計(jì)劃項(xiàng)目(2016YFB0201404) 十二五863重大項(xiàng)目(2014AA01A302)
【分類號(hào)】:TP38
本文編號(hào):2387401
[Abstract]:The high performance computing environment aggregates many high performance computing resources distributed in different regions and different organizations, and provides users with uniform access and usage methods. The system middleware matches the appropriate high performance computing resources according to the user's job request. With the opening of the environment application programming interface and the large increase of the number of job requests, when the high concurrent jobs submit requests, the current instant scheduling model will lead to a certain number of requests processing failure due to network and other reasons. At the same time, lack of flexibility. Aiming at this problem, the environment job scheduling model is optimized, the job environment queue is introduced, the state of the job system layer is refined, the job scheduling policy is configurable, and the prototype of the system is implemented based on the environment middleware SCE. After testing, under the workload of processing nearly 200 job submission requests per minute by single core service, there is no error phenomenon caused by system and network reasons. Of the 1 000 jobs, nearly 500 job requests are completed within 0.3 s, and more than 800 job submission requests are completed within 0.5 s.
【作者單位】: 中國(guó)科學(xué)院計(jì)算機(jī)網(wǎng)絡(luò)信息中心;
【基金】:國(guó)家重點(diǎn)研發(fā)計(jì)劃項(xiàng)目(2016YFB0201404) 十二五863重大項(xiàng)目(2014AA01A302)
【分類號(hào)】:TP38
【相似文獻(xiàn)】
相關(guān)期刊論文 前5條
1 陳江峰;;淺談中職計(jì)算機(jī)電子作業(yè)管理的有效方案[J];中等職業(yè)教育;2012年22期
2 李小娟;M340中型機(jī)作業(yè)保護(hù)與自動(dòng)重新啟動(dòng)[J];廈門大學(xué)學(xué)報(bào)(自然科學(xué)版);1994年03期
3 鄧正宏;張小芳;;過(guò)程化作業(yè)網(wǎng)絡(luò)調(diào)度方法的研究[J];微電子學(xué)與計(jì)算機(jī);2008年04期
4 王英;;基于FTP的中職學(xué)校計(jì)算機(jī)實(shí)驗(yàn)作業(yè)管理[J];福建電腦;2012年04期
5 ;[J];;年期
相關(guān)重要報(bào)紙文章 前1條
1 ;日立JP1全系統(tǒng)運(yùn)維管理解決方案[N];電腦商報(bào);2006年
相關(guān)碩士學(xué)位論文 前2條
1 王晨;PSO-BP模型在VDT作業(yè)疲勞評(píng)價(jià)中的應(yīng)用研究[D];首都經(jīng)濟(jì)貿(mào)易大學(xué);2012年
2 付云虹;基于BACKFILL的并行計(jì)算作業(yè)調(diào)度算法研究[D];湖南大學(xué);2007年
,本文編號(hào):2387401
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2387401.html
最近更新
教材專著