發(fā)布時(shí)間：2018-01-13 17:11

  本文關(guān)鍵詞：MiniQQ項(xiàng)目的數(shù)據(jù)存儲(chǔ)模塊的設(shè)計(jì)與實(shí)現(xiàn)　出處：《哈爾濱工業(yè)大學(xué)》2012年碩士論文　論文類型：學(xué)位論文

  更多相關(guān)文章： 海量數(shù)據(jù)存儲(chǔ) 高并發(fā)訪問(wèn) 負(fù)載均衡 數(shù)據(jù)分片 復(fù)制技術(shù)

【摘要】：當(dāng)今的互聯(lián)網(wǎng)應(yīng)用呈現(xiàn)出海量數(shù)據(jù)存儲(chǔ)、隨機(jī)訪問(wèn)和數(shù)據(jù)庫(kù)查詢頻度非常高，而數(shù)據(jù)更新的頻度相對(duì)較低的特點(diǎn)。人們對(duì)互聯(lián)網(wǎng)應(yīng)用的并發(fā)性能也提出了更高的要求。面對(duì)這些挑戰(zhàn)，傳統(tǒng)的數(shù)據(jù)庫(kù)服務(wù)器已經(jīng)不能滿足當(dāng)前互聯(lián)網(wǎng)的需求。因此，人們開(kāi)始考慮使用何種技術(shù)與架構(gòu)來(lái)解決這些問(wèn)題，由此帶來(lái)了一些新的技術(shù)問(wèn)題：海量數(shù)據(jù)存儲(chǔ)、負(fù)載均衡、數(shù)據(jù)庫(kù)復(fù)制、讀寫分離、透明訪問(wèn)等。作為一個(gè)大型的互聯(lián)網(wǎng)應(yīng)用公司，為了給用戶提供更好的優(yōu)質(zhì)體驗(yàn)，在日常開(kāi)發(fā)中必須解決這些問(wèn)題，并進(jìn)行長(zhǎng)期的優(yōu)化。因此公司提出了這樣一個(gè)mini項(xiàng)目來(lái)對(duì)此進(jìn)行研究，為日后的工作與深入研究打下基礎(chǔ)。 本文首先對(duì)整個(gè)項(xiàng)目的整體需求進(jìn)行了系統(tǒng)分析，明確了本課題在實(shí)現(xiàn)基本功能的基礎(chǔ)上還應(yīng)解決的核心問(wèn)題，如海量數(shù)據(jù)存儲(chǔ)、高并發(fā)訪問(wèn)、數(shù)據(jù)一致性、容災(zāi)備份等。本文對(duì)國(guó)內(nèi)外現(xiàn)狀進(jìn)行研究之后，結(jié)合公司的成型技術(shù)，在MiniQQ項(xiàng)目的存儲(chǔ)模塊設(shè)計(jì)中，設(shè)計(jì)并實(shí)踐了一套解決方案，實(shí)現(xiàn)了整個(gè)系統(tǒng)的基本功能需求，實(shí)現(xiàn)了對(duì)海量數(shù)據(jù)存儲(chǔ)的支持，能夠支持一定量級(jí)的高并發(fā)訪問(wèn)，確保了用戶數(shù)據(jù)的一致性與容災(zāi)。最后通過(guò)功能與性能測(cè)試證明了該解決方案的可行性與正確性。 本文主要圍繞這套解決方案的設(shè)計(jì)與實(shí)現(xiàn)進(jìn)行分析描述，主要包含了整體架構(gòu)的設(shè)計(jì)，相關(guān)技術(shù)的介紹，，數(shù)據(jù)分片技術(shù)在海量數(shù)據(jù)存儲(chǔ)中的應(yīng)用，復(fù)制技術(shù)、負(fù)載均衡、讀寫分離在高并發(fā)訪問(wèn)和數(shù)據(jù)一致性上的應(yīng)用，內(nèi)存數(shù)據(jù)庫(kù)在數(shù)據(jù)存儲(chǔ)模塊中的使用。
[Abstract]:In today's Internet Applications presents a massive data storage, random access and database query frequency is very high, and the characteristics of frequency of data update is relatively low. Concurrent performance of people on the Internet application is also put forward higher requirements. In the face of these challenges, the traditional database server has been unable to meet the current needs of the Internet. Therefore, people to solve these problems began to consider what kind of technology and architecture, which brings some new technical problems: massive data storage, load balancing, database replication, read-write separation, transparent access and so on. As a large Internet App Co, in order to provide a better quality of experience, in the day-to-day development of these problems must be solved for a long time, and optimization. So the company proposed to study such a mini project, and further study on after work Lay the foundation.
Firstly, the overall demand for the entire project to carry on the system analysis, the key issue of this paper should also solve on the basis of the realization of the basic functions of the sea quantity data storage, high concurrency, data consistency, disaster recovery and so on. Then this paper makes a research on the status quo at home and abroad, combined with the molding technology company, in the the design of storage module in MiniQQ project design and practice a set of solutions to achieve the basic functional requirements of the whole system, the realization of mass data storage, high concurrency can support a certain magnitude of the visit, to ensure consistency and recovery of user data. Finally, functional testing and performance testing to prove the feasibility of the the solution and correctness.
This paper mainly focuses on the design and implementation of this solution is described, including the overall architecture design, related technology, application, data slicing technology in mass data storage in the replication technology, load balancing, read-write separation in the application of high concurrent access and data consistency of the database, the use of memory in the data storage module.

【學(xué)位授予單位】：哈爾濱工業(yè)大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 金玲玲;MySQL數(shù)據(jù)庫(kù)中InnoDB數(shù)據(jù)表的使用[J];電腦知識(shí)與技術(shù);2004年32期

2 閆秋玲;朱軍濤;;分布式數(shù)據(jù)庫(kù)的復(fù)制和分片[J];電腦知識(shí)與技術(shù);2008年26期

3 寧華華;王慧;;分布式數(shù)據(jù)庫(kù)的復(fù)制和分片[J];電腦知識(shí)與技術(shù);2009年19期

4 龐惠;翟正利;;論分布式數(shù)據(jù)庫(kù)[J];電腦知識(shí)與技術(shù);2011年02期

5 許麗花;;內(nèi)存數(shù)據(jù)庫(kù)的關(guān)鍵技術(shù)研究[J];電腦知識(shí)與技術(shù);2011年36期

6 買京京;龔紅艷;宋純賀;;集群系統(tǒng)中的動(dòng)態(tài)反饋負(fù)載均衡策略[J];計(jì)算機(jī)工程;2008年16期

7 蔡亮;劉騰;;基于寫操作集的數(shù)據(jù)庫(kù)同步復(fù)制模型[J];計(jì)算機(jī)工程;2011年13期

8 蓋九宇,張忠能,肖鶴;分布式數(shù)據(jù)庫(kù)數(shù)據(jù)復(fù)制技術(shù)的分析與應(yīng)用[J];計(jì)算機(jī)應(yīng)用與軟件;2005年07期

9 周游弋;董道國(guó);金城;;高并發(fā)集群監(jiān)控系統(tǒng)中內(nèi)存數(shù)據(jù)庫(kù)的設(shè)計(jì)與應(yīng)用[J];計(jì)算機(jī)應(yīng)用與軟件;2011年06期

10 薛獻(xiàn)鵬;彭明田;賀懷清;;基于Memcached的日歷搜索引擎系統(tǒng)優(yōu)化設(shè)計(jì)與實(shí)現(xiàn)[J];計(jì)算機(jī)應(yīng)用;2011年03期

本文編號(hào)：1419754