一種大數(shù)據(jù)存儲(chǔ)模型的研究與應(yīng)用
發(fā)布時(shí)間：2018-02-04 17:17
本文關(guān)鍵詞： 數(shù)據(jù)庫(kù) 大數(shù)據(jù) 關(guān)系數(shù)據(jù)存儲(chǔ)模型 面向?qū)ο?/strong> 出處：《北京郵電大學(xué)》2013年碩士論文 論文類(lèi)型：學(xué)位論文
【摘要】：在大數(shù)據(jù)環(huán)境下,數(shù)據(jù)存儲(chǔ)出現(xiàn)了許多新的需求,傳統(tǒng)基于關(guān)系數(shù)據(jù)庫(kù)的數(shù)據(jù)存儲(chǔ)方式不能滿(mǎn)足這些需求,許多應(yīng)用系統(tǒng)逐漸傾向于使用NoSQL解決大數(shù)據(jù)存儲(chǔ)問(wèn)題。然而,NoSQL放棄了對(duì)關(guān)系操作的支持,使得部分已有應(yīng)用系統(tǒng)難以使用簡(jiǎn)單的方式進(jìn)行移植。 該論文參考現(xiàn)有大數(shù)據(jù)存儲(chǔ)的一些典型方案,提出一種兼容關(guān)系存儲(chǔ)模型的大數(shù)據(jù)存儲(chǔ)方案,該方案不僅能夠滿(mǎn)足大數(shù)據(jù)存儲(chǔ)的需求,還能夠支持大多數(shù)關(guān)系操作,從而使原有基于關(guān)系數(shù)據(jù)庫(kù)的系統(tǒng)能夠簡(jiǎn)單方便地移植到新的存儲(chǔ)方案中。 為實(shí)現(xiàn)上述目標(biāo),論文進(jìn)行了下述研究工作：(1)對(duì)幾種典型的NoSQL存儲(chǔ)模型以及一些基于關(guān)系數(shù)據(jù)庫(kù)的分布式存儲(chǔ)方案進(jìn)行深入研究,分析其工作原理與設(shè)計(jì)思想,明確論文方案的技術(shù)難點(diǎn)；(2)針對(duì)論文方案的各項(xiàng)技術(shù)難點(diǎn),進(jìn)行重點(diǎn)攻破,論文引入面向?qū)ο笤O(shè)計(jì)思想,設(shè)計(jì)三維關(guān)系模型,解決原有關(guān)系模型擴(kuò)展性問(wèn)題,并在三維關(guān)系模型基礎(chǔ)上,設(shè)計(jì)基于類(lèi)型的數(shù)據(jù)切分方案以及分布式并行計(jì)算方案,滿(mǎn)足海量數(shù)據(jù)實(shí)時(shí)處理的需求；(3)將論文方案應(yīng)用到具體的集群環(huán)境中,與原有方案進(jìn)行對(duì)比分析,并進(jìn)行改進(jìn)與完善。 該論文選題來(lái)源于國(guó)家“十一五”科技重點(diǎn)支撐計(jì)劃的免費(fèi)孕前優(yōu)生健康檢查項(xiàng)目,并最終用于解決該項(xiàng)目數(shù)據(jù)存儲(chǔ)的結(jié)構(gòu)復(fù)雜、數(shù)據(jù)量大、查詢(xún)緩慢等問(wèn)題,目前已取得一定成效。該論文提出的方案可以解決關(guān)系數(shù)據(jù)模型的擴(kuò)展性問(wèn)題,提高關(guān)系數(shù)據(jù)庫(kù)數(shù)據(jù)查詢(xún)效率,在海量關(guān)系型數(shù)據(jù)無(wú)法進(jìn)行NoSQL移植時(shí),可作為存儲(chǔ)優(yōu)化方案,解決數(shù)據(jù)存儲(chǔ)問(wèn)題。
[Abstract]:In big data environment, there are many new requirements for data storage, which can not be met by traditional data storage methods based on relational database. Many applications tend to use NoSQL to solve big data storage problems. However, NoSQL gives up support for relational operations. Some existing application systems are difficult to transplant in a simple way. Referring to some typical schemes of big data storage, this paper proposes a big data storage scheme for compatible relational storage model, which can not only meet big data storage requirements. It can also support most relational operations, so that the existing relational database system can be easily transplanted to the new storage scheme. In order to achieve the above goal, this paper carries out the following research work: 1) deeply study several typical NoSQL storage models and some distributed storage schemes based on relational database. The working principle and design idea are analyzed, and the technical difficulties of the thesis scheme are clarified. 2) aiming at the technical difficulties of the thesis scheme, the paper introduces the object-oriented design idea, designs the three-dimensional relational model, and solves the expansibility problem of the original relational model. On the basis of the 3D relational model, the data segmentation scheme based on type and the distributed parallel computing scheme are designed to meet the demand of real-time processing of massive data. 3) apply the thesis scheme to the concrete cluster environment, compare and analyze with the original scheme, and improve and perfect it. The topic of this paper comes from the national "11th Five-Year" science and technology key support plan of the free pre-pregnancy health check project, and ultimately used to solve the project data storage structure complex, data volume. Some problems, such as slow query, have been achieved at present. The scheme proposed in this paper can solve the expansibility of relational data model and improve the efficiency of query in relational database. When the massive relational data can not be transplanted into NoSQL, it can be used as a storage optimization scheme to solve the data storage problem.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2013
【分類(lèi)號(hào)】：TP333
【參考文獻(xiàn)】
相關(guān)期刊論文 前2條
1 白云川;;迎接大數(shù)據(jù)時(shí)代[J];中國(guó)制造業(yè)信息化;2011年12期
2 李未;郎波;;一種非結(jié)構(gòu)化數(shù)據(jù)庫(kù)的四面體數(shù)據(jù)模型[J];中國(guó)科學(xué):信息科學(xué);2010年08期
，本文編號(hào)：1490728
本文鏈接：http://sikaile.net/kejilunwen/jisuanjikexuelunwen/1490728.html
最近更新
教材專(zhuān)著
