MDLB:一種基于強(qiáng)化學(xué)習(xí)的元數(shù)據(jù)動(dòng)態(tài)負(fù)載均衡機(jī)制(英文)
發(fā)布時(shí)間:2021-04-09 02:37
隨著信息和數(shù)據(jù)量增長,面向?qū)ο蟮拇鎯?chǔ)系統(tǒng)已被廣泛應(yīng)用到很多領(lǐng)域,包括Google文件系統(tǒng)、AmazonS3、Hadoop分布式文件系統(tǒng)和Ceph。其中元數(shù)據(jù)負(fù)載均衡在提高整個(gè)系統(tǒng)輸入/輸出性能方面起著重要作用,元數(shù)據(jù)負(fù)載不平衡會(huì)導(dǎo)致服務(wù)器出現(xiàn)嚴(yán)重的系統(tǒng)性能瓶頸問題。然而現(xiàn)有元數(shù)據(jù)負(fù)載平衡策略缺乏良好動(dòng)態(tài)性和適用性,如基于子樹分割或者哈希的負(fù)載策略。提出一種基于強(qiáng)化學(xué)習(xí)的動(dòng)態(tài)負(fù)載平衡機(jī)制(MDLB)。采用Qlearning算法,所提基于強(qiáng)化學(xué)習(xí)機(jī)制由3個(gè)模塊組成,即策略選擇網(wǎng)絡(luò)、負(fù)載均衡網(wǎng)絡(luò)和參數(shù)更新網(wǎng)絡(luò)。實(shí)驗(yàn)結(jié)果表明MDLB算法可根據(jù)元數(shù)據(jù)服務(wù)器的性能動(dòng)態(tài)調(diào)節(jié)負(fù)載,在數(shù)據(jù)量驟變情況下仍具有很好適應(yīng)性。
【文章來源】:Frontiers of Information Technology & Electronic Engineering. 2020,21(07)EISCICSCD
【文章頁數(shù)】:14 頁
【文章目錄】:
1 Introduction
2 Related works
3 Problem definition
4 The proposed method
4.1 Reinforcement learning and the Q_learning algorithm
4.2 RL model for MDLB
4.2.1 Policy selection network
4.2.2 Metadata load balancing network
4.2.3 Parameter update network
4.3 Metadata dynamic load balancing mechanism
4.4 Reward and objective function
4.5 Algorithm complexity analysis
5 Experiments
5.1 Metadata server resource utilization analysis
5.2 Dynamic load balancing analysis
5.3 Metadata server delay overshoot and adjust-ment time analysis
5.4 Metadata distribution analysis
5.5 Discussion
6 Conclusions
Contributors
Compliance with ethics guidelines
【參考文獻(xiàn)】:
期刊論文
[1]對(duì)象存儲(chǔ)系統(tǒng)中自適應(yīng)的元數(shù)據(jù)負(fù)載均衡機(jī)制[J]. 陳濤,肖儂,劉芳. 軟件學(xué)報(bào). 2013(02)
[2]基于目錄路徑的元數(shù)據(jù)管理方法[J]. 劉仲,周興銘. 軟件學(xué)報(bào). 2007(02)
本文編號(hào):3126745
【文章來源】:Frontiers of Information Technology & Electronic Engineering. 2020,21(07)EISCICSCD
【文章頁數(shù)】:14 頁
【文章目錄】:
1 Introduction
2 Related works
3 Problem definition
4 The proposed method
4.1 Reinforcement learning and the Q_learning algorithm
4.2 RL model for MDLB
4.2.1 Policy selection network
4.2.2 Metadata load balancing network
4.2.3 Parameter update network
4.3 Metadata dynamic load balancing mechanism
4.4 Reward and objective function
4.5 Algorithm complexity analysis
5 Experiments
5.1 Metadata server resource utilization analysis
5.2 Dynamic load balancing analysis
5.3 Metadata server delay overshoot and adjust-ment time analysis
5.4 Metadata distribution analysis
5.5 Discussion
6 Conclusions
Contributors
Compliance with ethics guidelines
【參考文獻(xiàn)】:
期刊論文
[1]對(duì)象存儲(chǔ)系統(tǒng)中自適應(yīng)的元數(shù)據(jù)負(fù)載均衡機(jī)制[J]. 陳濤,肖儂,劉芳. 軟件學(xué)報(bào). 2013(02)
[2]基于目錄路徑的元數(shù)據(jù)管理方法[J]. 劉仲,周興銘. 軟件學(xué)報(bào). 2007(02)
本文編號(hào):3126745
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/3126745.html
最近更新
教材專著