基于移動ng4.0后臺驅(qū)動平臺的大數(shù)據(jù)同步的分析與研究
發(fā)布時間:2018-06-04 05:07
本文選題:大數(shù)據(jù) + CRM系統(tǒng); 參考:《湖南師范大學(xué)》2015年碩士論文
【摘要】:伴隨著大數(shù)據(jù)時代的到來,數(shù)據(jù)已經(jīng)成為了各大企業(yè)一筆重大的財富,怎樣將數(shù)據(jù)有效的管理起來便成了一個亟待解決的問題,將數(shù)據(jù)拆分出來保存在不同的地域和不同的存儲空間上,是一個有效解決數(shù)據(jù)管理問題的方案;于是對大數(shù)據(jù)同步的研究,便成為了一個熱門的研究方向。數(shù)據(jù)同步的研究在系統(tǒng)容災(zāi)、智慧校園、智慧農(nóng)業(yè)、智能物流等方面都得到了很多的應(yīng)用,具有重要的應(yīng)用意義。本文以“移動ng4.0項目改造工程”中的數(shù)據(jù)同步為背景,對目前移動NGBOSS系統(tǒng)中的CRM和BILLING兩大平臺進行了詳細的分析,針對移動業(yè)務(wù)運營支撐系統(tǒng)中CRM和BILLING系統(tǒng)之間數(shù)據(jù)同步存在的同步速度慢,出現(xiàn)誤差頻次高,需要人工處理概率大等問題提出了新的解決方案,本文的主要工作有以下兩點:針對目前業(yè)務(wù)運營支撐系統(tǒng)在生成同步文件的過程中沒有規(guī)范同步文件的大小,導(dǎo)致數(shù)據(jù)在同步過程中出現(xiàn)同步消耗時間長,甚至出現(xiàn)同步進程僵死,需要人工處理的問題,本文在同步流程中設(shè)計了一個自定義數(shù)據(jù)開關(guān),其主要思想是:將數(shù)據(jù)開關(guān)以參數(shù)的形式定義在XML文件中,用來規(guī)定每個同步文件能容納的數(shù)據(jù)閥值,CRM主機根據(jù)開關(guān)參數(shù)撈取同步數(shù)據(jù)。實驗數(shù)據(jù)表明這種方式能控制同步文件的大小,解決了由于同步文件過大導(dǎo)致同步數(shù)據(jù)失敗,進而影響整個系統(tǒng)運營的問題。針對同步文件中存在重復(fù)數(shù)據(jù),數(shù)據(jù)記錄排列雜亂無序,浪費磁盤空間,消耗網(wǎng)絡(luò)資源多,影響同步效率的問題,本文提出了對同步文件進行序列化處理的解決方案,其主要思想是:CRM側(cè)首先生成同步臨時文件,通過JAVA程序交叉調(diào)用Linux命令方法,對同步臨時文件進行合并,刪除文件中的重復(fù)記錄并重新編排同步文件序列,這種方法能有效的刪除同步文件中的冗余數(shù)據(jù),規(guī)范同步文件中的數(shù)據(jù)序列,有利于節(jié)省主機磁盤空間,減少文件在同步過程中對網(wǎng)絡(luò)資源的消耗,提高了數(shù)據(jù)入庫效率。
[Abstract]:With the arrival of the big data era, data has become a major wealth of large enterprises, how to effectively manage the data has become a problem to be solved. Splitting data into different regions and different storage space is an effective solution to the problem of data management, so the research on big data synchronization has become a hot research direction. The research of data synchronization has been applied in many fields, such as system disaster recovery, intelligent campus, intelligent agriculture, intelligent logistics and so on. Based on the background of data synchronization in "Mobile ng4.0 Project Reconstruction Project", this paper makes a detailed analysis of the two major platforms of CRM and BILLING in the current mobile NGBOSS system. Aiming at the problems of low synchronization speed, high error frequency and high probability of manual processing between CRM and BILLING systems in mobile business operation support system, a new solution is proposed. The main work of this paper is as follows: at present, the business operation support system does not standardize the size of the synchronization file in the process of generating synchronization files, which results in a long time of synchronization in the process of data synchronization. In this paper, a custom data switch is designed in the synchronization process. The main idea is to define the data switch in the XML file in the form of parameters. It is used to specify the data threshold for each synchronization file, and the CRM mainframe acquires synchronous data according to the switch parameters. The experimental data show that this method can control the size of the synchronization file and solve the problem of the failure of synchronization data caused by the too large synchronous file and then affect the operation of the whole system. Aiming at the problems of duplicated data in synchronous files, disorderly arrangement of data records, waste of disk space, consumption of network resources and influence of synchronization efficiency, this paper proposes a solution to serialize synchronous files. The main idea is to first generate synchronous temporary files on the: CRM side, cross call the Linux command method through JAVA program, merge the synchronous temporary files, delete the duplicate records in the files and rearrange the sequence of synchronous files. This method can effectively delete redundant data in synchronous files, standardize the data sequence in synchronous files, save host disk space, reduce the consumption of network resources in the synchronization process of files, and improve the efficiency of data storage.
【學(xué)位授予單位】:湖南師范大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2015
【分類號】:TP311.13
【參考文獻】
相關(guān)期刊論文 前1條
1 郭大春;田農(nóng)樂;;信息化校園建設(shè)中數(shù)據(jù)庫同步問題的研究[J];微型機與應(yīng)用;2011年06期
相關(guān)碩士學(xué)位論文 前1條
1 成靜靜;電信運營商BOSS系統(tǒng)的研究與設(shè)計[D];華南理工大學(xué);2010年
,本文編號:1976077
本文鏈接:http://sikaile.net/guanlilunwen/wuliuguanlilunwen/1976077.html
最近更新
教材專著