基于藍光存儲的異構云存儲平臺設計與研究
[Abstract]:With the wide application of the Internet in daily life, the amount of data in the network has increased exponentially. The IT industry has entered the storage era from the computing era. At present, many data centers are faced with the problems of huge system energy consumption, low utilization of storage resources and rising storage costs. Data show that storage costs account for 30-70% of the total cost of the data center. In the daily data generation, the frequently used data (hot data) accounts for only 20% of the total amount of data, and the data (cold data) that is rarely used or rarely used (cold data) is as high as 80%. In this case, there is a broad research and application prospect for hierarchical storage based on the characteristics of data cooling and heating, to give full play to the advantages of various storage devices and to reduce the total storage cost. Compared with the current development of storage media technology, the unit capacity of CD-ROMs is much lower than that of disks, and the speed of reading and writing is better than that of magnetic tape. Therefore, it is of practical significance to use optical disk as near-line or off-line storage device in hierarchical storage system. Based on the distributed file system, this paper introduces the Blu-ray optical disk library as the near-line storage device, and establishes a "on-line -near-line" hierarchical storage cloud storage platform. In the process of platform design and implementation, the main contents are as follows: (1) Research and analysis of current data differentiation technology, on the basis of which, through the analysis of user behavior log, the key features of user behavior are extracted. Establish data value model. In this model, the exponential smoothing method is used to fully consider the data value at each time, and the cold and hot data sets are distinguished according to the value of the data. This model can effectively improve the probability of users hitting online storage devices when accessing data in cloud platform. (2) Research data migration process control strategy, realize data before disk array and Blu-ray storage two different storage levels of devices automatically, An uninterrupted migration. The data migration process based on Blu-ray optical disk library is analyzed in order to ensure the consistency of data migration effectively. (3) the metadata server is separated from the application server, and the foreground page is separated from the background service. Realize each function of the platform, fully embody the low coupling software design idea. And a series of tests are carried out. The test results show that the data migration implemented by the platform is effective and accurate. It can efficiently transfer the data between the Blu-ray disc library and the disk, ensure the consistency of the data, and release the disk space. And improve the speed of data access.
【學位授予單位】:電子科技大學
【學位級別】:碩士
【學位授予年份】:2017
【分類號】:TP333
【參考文獻】
相關期刊論文 前10條
1 張晶;黃小鋒;;一種基于微服務的應用框架[J];計算機系統(tǒng)應用;2016年09期
2 栗輝;唐萌;陳豪;;基于用戶行為分析的網站結構優(yōu)化研究綜述[J];計算機科學;2016年S1期
3 劉建華;張智雄;;保存元數據的發(fā)展趨勢研究[J];圖書館雜志;2016年06期
4 朱明哲;劉婷;;藍光技術應用于廣電網絡儲存系統(tǒng)的可行性[J];中國有線電視;2016年02期
5 杜琳琳;;海量數據離線存儲系統(tǒng)研究[J];中國檔案;2016年02期
6 張滬寅;屈乾松;胡瑞蕓;;基于JSON的數據交換模型[J];計算機工程與設計;2015年12期
7 陳桂龍;;我國大數據發(fā)展狀況[J];中國建設信息化;2015年Z1期
8 羅圣美;張佳程;周揚;程舒晗;;TiStor:基于策略引擎的分級存儲系統(tǒng)[J];小型微型計算機系統(tǒng);2015年08期
9 劉勝久;李天瑞;珠杰;;Zipf定律與網絡信息計量學[J];中文信息學報;2015年04期
10 趙偉東;;電子檔案藍光存儲應用探究[J];檔案學研究;2015年03期
相關博士學位論文 前1條
1 鐘睿明;富云:一種跨越異構云平臺的互備可靠云存儲系統(tǒng)的實現機制研究[D];北京郵電大學;2014年
相關碩士學位論文 前7條
1 郭剛;內存云分級混合存儲架構數據遷移策略[D];新疆大學;2016年
2 武琢;在線存儲系統(tǒng)的設計與實現[D];內蒙古大學;2015年
3 盧俊華;HDFS存儲機制的分析與研究[D];武漢理工大學;2014年
4 劉曉然;基于文件的數據分級存儲的研究與實現[D];昆明理工大學;2013年
5 王艷云;分級存儲系統(tǒng)中數據遷移技術的研究[D];西安建筑科技大學;2012年
6 吳超龍;在線云存儲系統(tǒng)的設計與應用[D];華南理工大學;2010年
7 劉志寬;分級存儲系統(tǒng)中元數據管理的設計與實現[D];大連海事大學;2008年
,本文編號:2255343
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2255343.html