發(fā)布時(shí)間：2018-07-23 11:57

【摘要】：近年來(lái),在線網(wǎng)絡(luò)視頻業(yè)務(wù)已逐步發(fā)展為網(wǎng)絡(luò)音樂(lè)、網(wǎng)絡(luò)新聞和即時(shí)通信以外的第四大類(lèi)互聯(lián)網(wǎng)應(yīng)用,成為人們獲取電影、電視、視頻等數(shù)字內(nèi)容的重要媒介。P2P視頻點(diǎn)播業(yè)務(wù)作為目前主流的網(wǎng)絡(luò)視頻服務(wù)之一,擁有大規(guī)模的用戶群體。隨著互聯(lián)網(wǎng)基礎(chǔ)設(shè)施的大范圍普及和影視媒體琳瑯滿目的發(fā)展,越來(lái)越多的用戶選擇使用視頻點(diǎn)播服務(wù)來(lái)滿足自己獲取信息和娛樂(lè)的需求。然而,用戶數(shù)量的不斷增多和用戶對(duì)熱門(mén)節(jié)目需求的迅速增長(zhǎng)同時(shí)也為在線網(wǎng)絡(luò)視頻服務(wù)提出了更加嚴(yán)格的要求。 媒體數(shù)據(jù)量的急劇增長(zhǎng)為視頻點(diǎn)播系統(tǒng)帶來(lái)了新的問(wèn)題。首先,海量的媒體數(shù)據(jù)存儲(chǔ)為視頻點(diǎn)播系統(tǒng)帶來(lái)了巨大的硬件開(kāi)銷(xiāo)；其次,為了維持系統(tǒng)的正常運(yùn)轉(zhuǎn),系統(tǒng)的可用性及數(shù)據(jù)的可靠性需要得到保障；最后,為了滿足大量用戶同時(shí)使用系統(tǒng)服務(wù),同時(shí)使用戶獲得更流暢的播放體驗(yàn),需要盡可能的降低系統(tǒng)負(fù)載,提高系統(tǒng)性能。 P2P視頻點(diǎn)播系統(tǒng)中的媒體源服務(wù)器負(fù)責(zé)存儲(chǔ)系統(tǒng)中所有節(jié)目的完整數(shù)據(jù)。短時(shí)間內(nèi)大量并發(fā)的數(shù)據(jù)請(qǐng)求對(duì)媒體源服務(wù)器造成巨大的壓力,導(dǎo)致系統(tǒng)負(fù)載過(guò)高,資源占用率急劇升高,處理能力下降。另外,一些突發(fā)性的系統(tǒng)故障可能導(dǎo)致媒體源服務(wù)器宕機(jī)、系統(tǒng)崩潰甚至數(shù)據(jù)丟失,影響整個(gè)系統(tǒng)的正常運(yùn)行,最終導(dǎo)致視頻播放不流暢,用戶體驗(yàn)下降。 隨著信息服務(wù)的日益深化,越來(lái)越多的數(shù)據(jù)要求進(jìn)行長(zhǎng)期的低成本存儲(chǔ),海量數(shù)據(jù)的存儲(chǔ)和處理已成為當(dāng)前數(shù)據(jù)中心面臨的首要問(wèn)題,數(shù)據(jù)的分布式存儲(chǔ)及云計(jì)算技術(shù)迅速成為IT領(lǐng)域的研究熱點(diǎn)。Hadoop分布式文件系統(tǒng)(HDFS)是Apache Hadoop的基礎(chǔ)文件系統(tǒng),它能夠使用廉價(jià)的PC機(jī)集群構(gòu)建的系統(tǒng)為海量數(shù)據(jù)提供高可靠性、高容錯(cuò)性的保障,同時(shí)能夠?yàn)閿?shù)據(jù)密集型應(yīng)用提供高吞吐量的數(shù)據(jù)訪問(wèn),非常適合于大規(guī)模數(shù)據(jù)集長(zhǎng)期的低成本存儲(chǔ)。 本文針對(duì)P2P視頻點(diǎn)播系統(tǒng)中媒體源服務(wù)器的種種問(wèn)題,提出一項(xiàng)新的解決方案—基于HDFS的適用于P2P-VoD業(yè)務(wù)的分布式存儲(chǔ)系統(tǒng)。該分布式存儲(chǔ)系統(tǒng)利用HDFS的可擴(kuò)展性及可靠性特點(diǎn),同時(shí)在HDFS的數(shù)據(jù)節(jié)點(diǎn)上新增一項(xiàng)本地緩存的功能以改進(jìn)系統(tǒng)負(fù)載性能。通過(guò)搭建真實(shí)實(shí)驗(yàn)環(huán)境,使用多種測(cè)試方法從功能和性能上驗(yàn)證了該系統(tǒng)的可用性、可靠性,同時(shí)驗(yàn)證了改進(jìn)后的媒體源服務(wù)器在系統(tǒng)負(fù)載性能上得到了很大提升。
[Abstract]:In recent years, the online network video business has gradually developed into the fourth largest category of Internet applications other than network music, network news and instant messaging. As one of the mainstream network video services, P2P video-on-demand (VOD), an important medium of digital content such as video, has a large number of users. With the wide spread of Internet infrastructure and the development of video media, more and more users choose to use VOD services to meet their needs for information and entertainment. However, the increasing number of users and the rapid growth of users' demand for popular programs also put forward more stringent requirements for online video services. The rapid growth of media data has brought new problems to VOD system. First, mass media data storage brings huge hardware overhead for VOD system. Secondly, in order to maintain the normal operation of the system, the availability of the system and the reliability of the data need to be guaranteed. In order to satisfy a large number of users using system services at the same time, while enabling users to get a smoother playback experience, it is necessary to minimize the system load as much as possible. The media source server in P2P VOD system is responsible for storing the complete data of all programs in the system. A large number of concurrent data requests in a short period of time cause tremendous pressure on the media source server, resulting in excessive system load, a sharp increase in resource occupancy, and a decline in processing power. In addition, some sudden system failures may lead to media source server downtime, system crash or even data loss, affecting the normal operation of the entire system, resulting in the video playback is not smooth, user experience decline. With the deepening of information services, more and more data require long-term low-cost storage, mass data storage and processing has become the current data center facing the primary problem. Hadoop distributed file system (HDFS) is the basic file system of Apache Hadoop. It can provide high reliability for mass data by using cheap PC cluster system. The guarantee of high fault tolerance and the ability to provide high throughput data access for data-intensive applications are very suitable for the long-term low-cost storage of large data sets. Aiming at the problems of media source server in P2P VOD system, this paper presents a new solution, a distributed storage system based on HDFS for P2P-VoD services. The distributed storage system takes advantage of the extensibility and reliability of HDFS and adds a local cache to the data node of HDFS to improve the load performance of the system. The availability and reliability of the system are verified by using a variety of test methods in a real experimental environment. At the same time, it is verified that the improved media source server has greatly improved the load performance of the system.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類(lèi)號(hào)】：TP333

【共引文獻(xiàn)】

相關(guān)期刊論文 前3條

1 陳卓;馮鋼;周江;;分層P2P點(diǎn)播系統(tǒng)中優(yōu)化的帶寬資源分配策略[J];電子科技大學(xué)學(xué)報(bào);2014年03期

2 劉春陽(yáng);張鐵贏;陳國(guó)耀;余智華;;基于多任務(wù)下載的P2P-VoD系統(tǒng)的測(cè)量與分析[J];計(jì)算機(jī)科學(xué)與探索;2014年11期

3 陳靜;周兵;任晨珊;董小社;;分層P2P實(shí)時(shí)流媒體系統(tǒng)中基于演進(jìn)博弈的超級(jí)組對(duì)等節(jié)點(diǎn)選擇算法[J];通信學(xué)報(bào);2013年12期

相關(guān)博士學(xué)位論文 前5條

1 趙揚(yáng);基于用戶行為分析的視頻點(diǎn)播系統(tǒng)優(yōu)化技術(shù)研究[D];中國(guó)科學(xué)技術(shù)大學(xué);2014年

2 樊沛;虛擬計(jì)算環(huán)境中面向通信特征的應(yīng)用部署優(yōu)化技術(shù)研究[D];國(guó)防科學(xué)技術(shù)大學(xué);2012年

3 劉婷婷;基于WMN的P2P流媒體組播若干關(guān)鍵技術(shù)研究[D];北京交通大學(xué);2014年

4 徐嬴穎;云下載系統(tǒng)的理論模型與存儲(chǔ)資源分配算法研究[D];北京交通大學(xué);2014年

5 叢鑫;云輔助P2P-VoD系統(tǒng)服務(wù)器帶寬資源優(yōu)化關(guān)鍵技術(shù)研究[D];北京郵電大學(xué);2013年

相關(guān)碩士學(xué)位論文 前9條

1 張華;一種基于社會(huì)網(wǎng)絡(luò)特性的P2P視頻分享系統(tǒng)研究與仿真[D];重慶理工大學(xué);2013年

2 龔光敏;一種P2P視頻點(diǎn)播系統(tǒng)的日志分析子系統(tǒng)設(shè)計(jì)與實(shí)現(xiàn)[D];華中科技大學(xué);2013年

3 張小彪;基于網(wǎng)絡(luò)編碼的P2P點(diǎn)播算法設(shè)計(jì)與仿真[D];華中科技大學(xué);2013年

4 張U，

本文編號(hào)：2139337