云存儲(chǔ)環(huán)境中的遠(yuǎn)程文件同步模型研究
發(fā)布時(shí)間:2018-11-25 15:13
【摘要】:隨著移動(dòng)計(jì)算的出現(xiàn)、計(jì)算機(jī)硬件技術(shù)的發(fā)展與人們?nèi)找嬖鲩L(zhǎng)的應(yīng)用需求,越來(lái)越多的個(gè)人擁有多個(gè)智能計(jì)算設(shè)備。人們每天的工作與生活都依賴于這些計(jì)算設(shè)備上的大量信息數(shù)據(jù),因此安全有效地共享與管理多設(shè)備間的文件顯得非常重要。 遠(yuǎn)程文件同步服務(wù)能夠自動(dòng)維護(hù)多個(gè)設(shè)備之間的文件一致性,云存儲(chǔ)技術(shù)與NoSQL數(shù)據(jù)庫(kù)技術(shù)為用戶文件數(shù)據(jù)提供了安全、可擴(kuò)展的備份存儲(chǔ)。本文針對(duì)海量信息時(shí)代下的個(gè)人用戶多設(shè)備之間文件共享與管理的應(yīng)用需求,提出了一種云存儲(chǔ)環(huán)境中的遠(yuǎn)程文件同步模型——SyncCS模型。本文重點(diǎn)研究了遠(yuǎn)程文件同步模型的系統(tǒng)架構(gòu)、同步協(xié)議以及后臺(tái)存儲(chǔ)環(huán)境,完成的主要工作包括: 1.將遠(yuǎn)程文件同步技術(shù)與云存儲(chǔ)技術(shù)相結(jié)合,并考慮到傳統(tǒng)點(diǎn)對(duì)點(diǎn)文件同步模型的不足,提出了一種C/S架構(gòu)的云存儲(chǔ)環(huán)境中的遠(yuǎn)程文件同步模型——SyncCS模型,并構(gòu)建了模型的三層體系結(jié)構(gòu)。 2.設(shè)計(jì)了一種適用于SyncCS模型的兩階段文件同步協(xié)議,將文件同步過(guò)程分為非實(shí)時(shí)雙向同步和實(shí)時(shí)單向同步兩個(gè)階段,能夠兼顧文件雙向同步與實(shí)時(shí)同步兩種不同的用戶需求。同時(shí)充分研究并討論了在同步過(guò)程中可能發(fā)生的所有文件沖突情況,制定了與兩階段同步協(xié)議相適應(yīng)的文件沖突檢測(cè)與處理機(jī)制。 3.結(jié)合當(dāng)前炙手可熱的云存儲(chǔ)與NoSQL數(shù)據(jù)庫(kù)技術(shù),研究并構(gòu)造了SyncCS模型后臺(tái)云存儲(chǔ)環(huán)境,根據(jù)SyncCS模型中實(shí)際的數(shù)據(jù)特點(diǎn),分別提出了相適應(yīng)的元數(shù)據(jù)與文件數(shù)據(jù)存儲(chǔ)方案。 4.針對(duì)SyncCS模型中冗余日志帶來(lái)冗余同步操作的問(wèn)題,提出了一種客戶端日志預(yù)處理優(yōu)化方案;針對(duì)大量并發(fā)訪問(wèn)可能導(dǎo)致元數(shù)據(jù)服務(wù)器效率低下的問(wèn)題,提出了一種基于Hbase的元數(shù)據(jù)存儲(chǔ)優(yōu)化方案。并通過(guò)實(shí)驗(yàn)驗(yàn)證了兩個(gè)優(yōu)化方案的有效性,,從而分別從客戶端與服務(wù)器端對(duì)SyncCS模型進(jìn)行了性能改進(jìn)。
[Abstract]:With the emergence of mobile computing, the development of computer hardware technology and the increasing demand for applications, more and more individuals have multiple intelligent computing devices. The daily work and life of people depend on a large amount of information data on these computing devices, so it is very important to share and manage the files between multiple devices safely and effectively. Remote file synchronization service can automatically maintain file consistency between multiple devices. Cloud storage technology and NoSQL database technology provide secure and extensible backup storage for user file data. In this paper, a remote file synchronization model in cloud storage environment, SyncCS model, is proposed to meet the application requirements of file sharing and management between individual users and multi-devices in the age of mass information. This paper focuses on the system architecture, synchronization protocol and background storage environment of the remote file synchronization model. The main works are as follows: 1. Combine remote file synchronization technology with cloud storage technology. Considering the shortcomings of the traditional point-to-point file synchronization model, a remote file synchronization model called SyncCS model in cloud storage environment based on C / S architecture is proposed, and the three-tier architecture of the model is constructed. 2. A two-stage file synchronization protocol suitable for SyncCS model is designed. The file synchronization process is divided into two stages: non-real-time bidirectional synchronization and real-time one-way synchronization, which can take account of two different user requirements: bidirectional file synchronization and real-time file synchronization. At the same time, all possible file conflicts in the synchronization process are studied and discussed, and a file conflict detection and handling mechanism suitable to the two-stage synchronization protocol is developed. 3. Combined with the current hot cloud storage and NoSQL database technology, the background cloud storage environment of SyncCS model is studied and constructed. According to the actual data characteristics of SyncCS model, the corresponding metadata and file data storage schemes are put forward respectively. 4. Aiming at the problem of redundant log synchronization in SyncCS model, a preprocessing optimization scheme for client log is proposed. Aiming at the problem that a large number of concurrent access may lead to the inefficiency of metadata server, a metadata storage optimization scheme based on Hbase is proposed. The effectiveness of the two optimization schemes is verified by experiments, and the performance of the SyncCS model is improved from the client side and the server side respectively.
【學(xué)位授予單位】:上海大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2013
【分類號(hào)】:TP333
本文編號(hào):2356551
[Abstract]:With the emergence of mobile computing, the development of computer hardware technology and the increasing demand for applications, more and more individuals have multiple intelligent computing devices. The daily work and life of people depend on a large amount of information data on these computing devices, so it is very important to share and manage the files between multiple devices safely and effectively. Remote file synchronization service can automatically maintain file consistency between multiple devices. Cloud storage technology and NoSQL database technology provide secure and extensible backup storage for user file data. In this paper, a remote file synchronization model in cloud storage environment, SyncCS model, is proposed to meet the application requirements of file sharing and management between individual users and multi-devices in the age of mass information. This paper focuses on the system architecture, synchronization protocol and background storage environment of the remote file synchronization model. The main works are as follows: 1. Combine remote file synchronization technology with cloud storage technology. Considering the shortcomings of the traditional point-to-point file synchronization model, a remote file synchronization model called SyncCS model in cloud storage environment based on C / S architecture is proposed, and the three-tier architecture of the model is constructed. 2. A two-stage file synchronization protocol suitable for SyncCS model is designed. The file synchronization process is divided into two stages: non-real-time bidirectional synchronization and real-time one-way synchronization, which can take account of two different user requirements: bidirectional file synchronization and real-time file synchronization. At the same time, all possible file conflicts in the synchronization process are studied and discussed, and a file conflict detection and handling mechanism suitable to the two-stage synchronization protocol is developed. 3. Combined with the current hot cloud storage and NoSQL database technology, the background cloud storage environment of SyncCS model is studied and constructed. According to the actual data characteristics of SyncCS model, the corresponding metadata and file data storage schemes are put forward respectively. 4. Aiming at the problem of redundant log synchronization in SyncCS model, a preprocessing optimization scheme for client log is proposed. Aiming at the problem that a large number of concurrent access may lead to the inefficiency of metadata server, a metadata storage optimization scheme based on Hbase is proposed. The effectiveness of the two optimization schemes is verified by experiments, and the performance of the SyncCS model is improved from the client side and the server side respectively.
【學(xué)位授予單位】:上海大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2013
【分類號(hào)】:TP333
【參考文獻(xiàn)】
相關(guān)期刊論文 前3條
1 程瑩;張?jiān)朴?房秉毅;徐雷;;云計(jì)算時(shí)代的數(shù)據(jù)庫(kù)研究[J];電信技術(shù);2011年01期
2 林子雨;賴永炫;林琛;謝怡;鄒權(quán);;云數(shù)據(jù)庫(kù)研究[J];軟件學(xué)報(bào);2012年05期
3 周可;王樺;李春花;;云存儲(chǔ)技術(shù)及其應(yīng)用[J];中興通訊技術(shù);2010年04期
本文編號(hào):2356551
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/2356551.html
最近更新
教材專著