本文關(guān)鍵詞：MiniQQ項目的數(shù)據(jù)存儲模塊的設(shè)計與實現(xiàn)　出處：《哈爾濱工業(yè)大學(xué)》2012年碩士論文　論文類型：學(xué)位論文

  更多相關(guān)文章： 海量數(shù)據(jù)存儲 高并發(fā)訪問 負(fù)載均衡 數(shù)據(jù)分片 復(fù)制技術(shù)

【摘要】：當(dāng)今的互聯(lián)網(wǎng)應(yīng)用呈現(xiàn)出海量數(shù)據(jù)存儲、隨機訪問和數(shù)據(jù)庫查詢頻度非常高，而數(shù)據(jù)更新的頻度相對較低的特點。人們對互聯(lián)網(wǎng)應(yīng)用的并發(fā)性能也提出了更高的要求。面對這些挑戰(zhàn)，傳統(tǒng)的數(shù)據(jù)庫服務(wù)器已經(jīng)不能滿足當(dāng)前互聯(lián)網(wǎng)的需求。因此，人們開始考慮使用何種技術(shù)與架構(gòu)來解決這些問題，由此帶來了一些新的技術(shù)問題：海量數(shù)據(jù)存儲、負(fù)載均衡、數(shù)據(jù)庫復(fù)制、讀寫分離、透明訪問等。作為一個大型的互聯(lián)網(wǎng)應(yīng)用公司，為了給用戶提供更好的優(yōu)質(zhì)體驗，在日常開發(fā)中必須解決這些問題，并進(jìn)行長期的優(yōu)化。因此公司提出了這樣一個mini項目來對此進(jìn)行研究，為日后的工作與深入研究打下基礎(chǔ)。 本文首先對整個項目的整體需求進(jìn)行了系統(tǒng)分析，明確了本課題在實現(xiàn)基本功能的基礎(chǔ)上還應(yīng)解決的核心問題，如海量數(shù)據(jù)存儲、高并發(fā)訪問、數(shù)據(jù)一致性、容災(zāi)備份等。本文對國內(nèi)外現(xiàn)狀進(jìn)行研究之后，結(jié)合公司的成型技術(shù)，在MiniQQ項目的存儲模塊設(shè)計中，設(shè)計并實踐了一套解決方案，實現(xiàn)了整個系統(tǒng)的基本功能需求，實現(xiàn)了對海量數(shù)據(jù)存儲的支持，能夠支持一定量級的高并發(fā)訪問，確保了用戶數(shù)據(jù)的一致性與容災(zāi)。最后通過功能與性能測試證明了該解決方案的可行性與正確性。 本文主要圍繞這套解決方案的設(shè)計與實現(xiàn)進(jìn)行分析描述，主要包含了整體架構(gòu)的設(shè)計，相關(guān)技術(shù)的介紹，，數(shù)據(jù)分片技術(shù)在海量數(shù)據(jù)存儲中的應(yīng)用，復(fù)制技術(shù)、負(fù)載均衡、讀寫分離在高并發(fā)訪問和數(shù)據(jù)一致性上的應(yīng)用，內(nèi)存數(shù)據(jù)庫在數(shù)據(jù)存儲模塊中的使用。
[Abstract]:In today's Internet Applications presents a massive data storage, random access and database query frequency is very high, and the characteristics of frequency of data update is relatively low. Concurrent performance of people on the Internet application is also put forward higher requirements. In the face of these challenges, the traditional database server has been unable to meet the current needs of the Internet. Therefore, people to solve these problems began to consider what kind of technology and architecture, which brings some new technical problems: massive data storage, load balancing, database replication, read-write separation, transparent access and so on. As a large Internet App Co, in order to provide a better quality of experience, in the day-to-day development of these problems must be solved for a long time, and optimization. So the company proposed to study such a mini project, and further study on after work Lay the foundation.
Firstly, the overall demand for the entire project to carry on the system analysis, the key issue of this paper should also solve on the basis of the realization of the basic functions of the sea quantity data storage, high concurrency, data consistency, disaster recovery and so on. Then this paper makes a research on the status quo at home and abroad, combined with the molding technology company, in the the design of storage module in MiniQQ project design and practice a set of solutions to achieve the basic functional requirements of the whole system, the realization of mass data storage, high concurrency can support a certain magnitude of the visit, to ensure consistency and recovery of user data. Finally, functional testing and performance testing to prove the feasibility of the the solution and correctness.
This paper mainly focuses on the design and implementation of this solution is described, including the overall architecture design, related technology, application, data slicing technology in mass data storage in the replication technology, load balancing, read-write separation in the application of high concurrent access and data consistency of the database, the use of memory in the data storage module.

【學(xué)位授予單位】：哈爾濱工業(yè)大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2012
【分類號】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 金玲玲;MySQL數(shù)據(jù)庫中InnoDB數(shù)據(jù)表的使用[J];電腦知識與技術(shù);2004年32期

2 閆秋玲;朱軍濤;;分布式數(shù)據(jù)庫的復(fù)制和分片[J];電腦知識與技術(shù);2008年26期

3 寧華華;王慧;;分布式數(shù)據(jù)庫的復(fù)制和分片[J];電腦知識與技術(shù);2009年19期

4 龐惠;翟正利;;論分布式數(shù)據(jù)庫[J];電腦知識與技術(shù);2011年02期

5 許麗花;;內(nèi)存數(shù)據(jù)庫的關(guān)鍵技術(shù)研究[J];電腦知識與技術(shù);2011年36期

6 買京京;龔紅艷;宋純賀;;集群系統(tǒng)中的動態(tài)反饋負(fù)載均衡策略[J];計算機工程;2008年16期

7 蔡亮;劉騰;;基于寫操作集的數(shù)據(jù)庫同步復(fù)制模型[J];計算機工程;2011年13期

8 蓋九宇,張忠能,肖鶴;分布式數(shù)據(jù)庫數(shù)據(jù)復(fù)制技術(shù)的分析與應(yīng)用[J];計算機應(yīng)用與軟件;2005年07期

9 周游弋;董道國;金城;;高并發(fā)集群監(jiān)控系統(tǒng)中內(nèi)存數(shù)據(jù)庫的設(shè)計與應(yīng)用[J];計算機應(yīng)用與軟件;2011年06期

10 薛獻(xiàn)鵬;彭明田;賀懷清;;基于Memcached的日歷搜索引擎系統(tǒng)優(yōu)化設(shè)計與實現(xiàn)[J];計算機應(yīng)用;2011年03期

本文編號：1419754