基于井下數(shù)據(jù)中心虛擬數(shù)據(jù)整合模型研究
發(fā)布時間:2018-03-27 21:05
本文選題:數(shù)據(jù)虛擬 切入點:井下數(shù)據(jù)中心 出處:《東北石油大學》2013年碩士論文
【摘要】:隨著信息技術的不斷發(fā)展,,數(shù)據(jù)種類、數(shù)據(jù)存儲量都在不斷增加,企業(yè)信息化建設不斷加快。由于采用數(shù)據(jù)標準不統(tǒng)一等原因,企業(yè)內(nèi)部與企業(yè)間的數(shù)據(jù)交流難度越來越大,數(shù)據(jù)孤島的數(shù)量急劇增加。如何利用好已經(jīng)獲取的數(shù)據(jù)對企業(yè)的業(yè)務活動及決策進行有效支撐,已經(jīng)成為企業(yè)信息化過程的一個至關重要的問題。面對著日漸復雜的數(shù)據(jù)生存環(huán)境,建立多個數(shù)據(jù)孤島之間的交流已是企業(yè)信息化建設的首要任務。通過分析井下作業(yè)分公司數(shù)據(jù)中心建設中各數(shù)據(jù)源存在的分布性、異構(gòu)性、自治性等特點。對虛擬數(shù)據(jù)整合模型及其實現(xiàn)技術進行充分研究,提出了虛擬數(shù)據(jù)整合體系結(jié)構(gòu),構(gòu)建了虛擬數(shù)據(jù)整合元數(shù)據(jù)模型,基于該模型實現(xiàn)信息孤島間的數(shù)據(jù)整合。 首先,針對數(shù)據(jù)源分散狀況,建立了數(shù)據(jù)源層。利用元數(shù)據(jù)技術,建立了虛擬數(shù)據(jù)整合數(shù)據(jù)場地元模型。通過元模型實現(xiàn)多個分散數(shù)據(jù)源的邏輯整合,形成數(shù)據(jù)統(tǒng)一訪問邏輯接口。為有效解決數(shù)據(jù)源訪問效率低的問題,采用數(shù)據(jù)分割技術構(gòu)建數(shù)據(jù)訪問層。細化了所訪問數(shù)據(jù)的粒度,提高數(shù)據(jù)訪問效率。 其次,針對異構(gòu)數(shù)據(jù)模型間的整合問題,以數(shù)據(jù)中心數(shù)據(jù)字典為框架,建立了對多個異構(gòu)數(shù)據(jù)模型的映射支撐模型。通過元數(shù)據(jù)模型驅(qū)動實現(xiàn)數(shù)據(jù)轉(zhuǎn)換層,對分割后的數(shù)據(jù)實現(xiàn)數(shù)據(jù)轉(zhuǎn)換。同時結(jié)合內(nèi)存映射原理,引用MongoDB作為數(shù)據(jù)緩存帶,將讀取到的大量數(shù)據(jù)存入MongoDB緩存,對緩存的數(shù)據(jù)實現(xiàn)并行轉(zhuǎn)換處理,提高了數(shù)據(jù)整合的效率。 最后,基于虛擬數(shù)據(jù)整合元模型,結(jié)合中間件、數(shù)據(jù)物化與NOSQL相關技術,實現(xiàn)數(shù)據(jù)應用層,參照虛擬數(shù)據(jù)整合模型中應用元模型對數(shù)據(jù)進行整合,展示、轉(zhuǎn)儲,滿足企業(yè)對數(shù)據(jù)的應用需求。 本文通過研究虛擬整合模型及其實現(xiàn)技術研究,實現(xiàn)基于元數(shù)據(jù)的虛擬數(shù)據(jù)整合體系框架,并實現(xiàn)了原型系統(tǒng),驗證了虛擬整合體系結(jié)構(gòu)合理性,完成井下數(shù)據(jù)中心虛擬數(shù)據(jù)整合,實踐證明模型及技術的可行性。
[Abstract]:With the continuous development of information technology, the data types and data storage are increasing, and the construction of enterprise information is accelerating. Because of different data standards, it is more and more difficult to communicate data between enterprises and enterprises. The number of data islands has increased dramatically. How to make good use of the acquired data to effectively support the business activities and decisions of enterprises, It has become a crucial problem in the process of enterprise informatization. In the face of increasingly complex data living environment, It is the most important task of enterprise information construction to establish the exchange among multiple data islands. By analyzing the distribution and heterogeneity of the data sources in the construction of data center of underground operation branch, the paper analyzes the distribution and heterogeneity of the data sources in the construction of the data center of the underground branch. Based on the study of the virtual data integration model and its implementation technology, the virtual data integration architecture is proposed, and the virtual data integration metadata model is constructed. Based on the model, the data integration between isolated information islands is realized. Firstly, according to the situation of data source dispersion, the data source layer is established. Using metadata technology, the virtual data integration data site meta-model is established. Through the meta-model, the logical integration of multiple decentralized data sources is realized. In order to solve the problem of low access efficiency of data sources, the data access layer is constructed by using data segmentation technology, which refines the granularity of the data accessed and improves the efficiency of data access. Secondly, aiming at the problem of integration between heterogeneous data models, a mapping support model of multiple heterogeneous data models is established based on the data center data dictionary, which is driven by metadata model to realize data conversion layer. At the same time, the MongoDB is used as the data cache band, the large amount of data is stored in the MongoDB cache, the cached data is converted into parallel processing, and the efficiency of data integration is improved. Finally, based on virtual data integration metamodel, combining middleware, data materialization and NOSQL technology, the data application layer is realized. According to the application metadata model of virtual data integration model, the data is integrated, displayed and stored. To meet the data application requirements of enterprises. Through the research of virtual integration model and its implementation technology, this paper realizes the framework of virtual data integration based on metadata, and implements the prototype system, which verifies the rationality of virtual integration architecture. The virtual data integration of the underground data center is completed, and the feasibility of the model and technology is proved by practice.
【學位授予單位】:東北石油大學
【學位級別】:碩士
【學位授予年份】:2013
【分類號】:TP308
【參考文獻】
相關期刊論文 前10條
1 王宏鼎;譚少華;唐世渭;楊冬青;童云海;;基于模式元素語義關系的模式合并方法研究[J];北京大學學報(自然科學版)網(wǎng)絡版(預印本);2006年04期
2 劉高軍;鮑曉琦;;基于聯(lián)邦數(shù)據(jù)庫的數(shù)據(jù)集成平臺研究與改進[J];計算機光盤軟件與應用;2012年02期
3 黃U
本文編號:1673233
本文鏈接:http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1673233.html
最近更新
教材專著