【摘要】：FTP是一種廣泛使用的網(wǎng)絡(luò)服務(wù)，它是數(shù)據(jù)傳輸?shù)闹匾ㄐ欧绞�，大多�?shù)的文件上傳和下載任務(wù)都是靠FTP完成的，它實(shí)現(xiàn)了可靠且有效傳輸數(shù)據(jù)的功能；同時(shí)，只要進(jìn)行文件傳輸?shù)牟僮飨到y(tǒng)都支持FTP協(xié)議，就可以方便地在不同類型的計(jì)算機(jī)之間進(jìn)行文件傳輸，使文件傳輸操作不會(huì)因?yàn)楦黝愔鳈C(jī)文件存儲(chǔ)系統(tǒng)的差異而受影響。因此，F(xiàn)TP一直是Internet上廣泛使用的服務(wù)。 FTP服務(wù)器為客戶提供文件上傳和下載的雙向服務(wù)，而當(dāng)前的應(yīng)用及研究更多地側(cè)重在FTP下載技術(shù)上，對(duì)于上傳技術(shù)的研究則涉及甚少，尤其是對(duì)單個(gè)大文件有效上傳技術(shù)的研究則更少。然而，現(xiàn)在網(wǎng)絡(luò)實(shí)際使用中，經(jīng)常需要傳輸以GB為單位的大文件，如多媒體文件共享等應(yīng)用。大文件上傳效率的高低對(duì)于多媒體文件的網(wǎng)絡(luò)共享等應(yīng)用顯得越來越重要。但是，，由于這些文件容量巨大，使用傳統(tǒng)單線程FTP上傳的方式耗時(shí)長(zhǎng)，上傳過程最容易發(fā)生意外中斷，導(dǎo)致文件重新上傳的操作頻繁，極大影響了數(shù)據(jù)共享的效率。再如：利用某超算中心進(jìn)行高性能相關(guān)的計(jì)算時(shí)，客戶端的用戶需通過VPN網(wǎng)絡(luò)上傳大量的計(jì)算數(shù)據(jù),經(jīng)過超級(jí)計(jì)算機(jī)計(jì)算后取得結(jié)果，如果使用傳統(tǒng)FTP上傳，效率會(huì)很低，而采用多線程斷點(diǎn)上傳技術(shù)可以發(fā)揮顯著的優(yōu)勢(shì)。由此可見，大文件上傳技術(shù)的研究對(duì)于促進(jìn)網(wǎng)絡(luò)應(yīng)用發(fā)展有著重大的意義。 傳統(tǒng)FTP采用單線程上傳文件，在網(wǎng)絡(luò)帶寬有限的條件下，對(duì)帶寬的搶占優(yōu)勢(shì)小，導(dǎo)致上傳速度慢；同時(shí)，一旦發(fā)生意外中斷，就需要重新上傳文件的全部數(shù)據(jù)，極大地影響了數(shù)據(jù)上傳的效率。本文提出了根據(jù)實(shí)際情況對(duì)文件合理分塊、智能為每個(gè)線程分配傳輸任務(wù)等一系列技術(shù)，通過多線程并行作業(yè)和斷點(diǎn)恢復(fù)上傳的方法，可以有效解決傳統(tǒng)FTP上傳操作中存在的問題。 同時(shí)，由于Linux操作系統(tǒng)具有開放性、高效性、良好的可移植性和豐富的網(wǎng)絡(luò)功能等諸多優(yōu)勢(shì)，因此，在設(shè)計(jì)實(shí)現(xiàn)階段選擇了基于Linux操作系統(tǒng)，使用C++編程語(yǔ)言開發(fā)一套FTP客戶端軟件。經(jīng)過大量對(duì)比試驗(yàn)和測(cè)試數(shù)據(jù)的全面分析，充分證明本技術(shù)方法的可行性與有效性，證明本論文提出的技術(shù)方案可以大幅度提高大文件上傳的效率，尤其對(duì)單個(gè)大文件的上傳效率的提升效果明顯。
[Abstract]:FTP is a widely used network service, it is an important communication mode of data transmission. Most of the tasks of file upload and download are accomplished by FTP, which realizes the function of reliable and effective data transmission. As long as the operating system for file transfer supports FTP protocol, it can easily transfer files between different types of computers, so that file transfer operations will not be affected by the differences of file storage systems in all kinds of hosts. Therefore, FTP server has always been a widely used service on Internet. FTP server provides bidirectional service for file upload and download to clients, and the current application and research focus more on FTP download technology. There are few researches on upload technology, especially on single large file efficient upload technology. However, it is often necessary to transfer large files based on GB, such as multimedia file sharing and so on. The efficiency of large file upload is becoming more and more important for the network sharing of multimedia files. However, because of the huge capacity of these files, the traditional single-threaded FTP upload mode takes a long time, and the uploading process is most likely to be interrupted by accident, which leads to frequent file re-upload operations, which greatly affect the efficiency of data sharing. For example, when making use of a supercomputing center for high performance related calculations, the client users need to upload a large amount of computing data through the VPN network, and the results are obtained after the supercomputer calculation. If the traditional FTP is used to upload, the efficiency will be very low. The use of multi-thread breakpoint upload technology can play a significant advantage. It can be seen that the research of large file upload technology is of great significance to promote the development of network applications. Under the condition of limited network bandwidth, the traditional FTP uses single thread to upload files. Under the condition of limited network bandwidth, the preemptive advantage of bandwidth is small, which results in slow uploading speed. At the same time, once unexpected interruption occurs, all the data of the file need to be uploaded again. It greatly affects the efficiency of data upload. In this paper, according to the actual situation, a series of techniques, such as reasonably dividing files into blocks and intelligently assigning transmission tasks to each thread, are put forward to restore uploading by multi-thread parallel jobs and breakpoints. It can effectively solve the problems existing in the traditional FTP upload operation. At the same time, because the Linux operating system has many advantages, such as openness, high efficiency, good portability and rich network function, so in the stage of design and implementation, the Linux operating system is chosen. Use C programming language to develop a set of FTP client software. The feasibility and effectiveness of this technical method are fully proved through a large number of comparative experiments and comprehensive analysis of test data. It is proved that the technical scheme proposed in this paper can greatly improve the efficiency of large file uploading. Especially for a single large file upload efficiency effect is obvious.
【學(xué)位授予單位】：華南理工大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2014
【分類號(hào)】：TP393.09

【參考文獻(xiàn)】

相關(guān)期刊論文 前7條

1 黎苑文;程明智;徐秀花;楊義先;;斷點(diǎn)續(xù)傳及多線程機(jī)制在遠(yuǎn)程傳版中的應(yīng)用研究[J];北京印刷學(xué)院學(xué)報(bào);2012年06期

2 駱斌,費(fèi)翔林;多線程技術(shù)的研究與應(yīng)用[J];計(jì)算機(jī)研究與發(fā)展;2000年04期

3 劉軼,鄭守淇,錢德沛;一種分布式共享存儲(chǔ)系統(tǒng)的線程分配算法[J];計(jì)算機(jī)研究與發(fā)展;2000年05期

4 鄭燕飛,余海燕;Linux的多線程機(jī)制探討與實(shí)踐[J];計(jì)算機(jī)應(yīng)用;2001年01期

5 黃珍生;;一種基于帶寬的文件分塊動(dòng)態(tài)下載模型[J];計(jì)算機(jī)應(yīng)用與軟件;2010年10期

6 廖樂林;;斷點(diǎn)續(xù)傳的原理探討和編程應(yīng)用[J];科技信息(科學(xué)教研);2007年23期

7 王魁生;盧夢(mèng)僑;王曉波;;一種基于網(wǎng)絡(luò)狀況的多線程下載調(diào)度算法[J];軟件導(dǎo)刊;2011年04期

本文編號(hào)：2248566