本文選題：卷積神經(jīng)網(wǎng)絡(luò)　切入點：并行化　出處：《鄭州大學》2013年碩士論文

【摘要】：卷積神經(jīng)網(wǎng)絡(luò)(Convolutional Neural NetWorks, CNN);算法能夠有效地從原始輸入中學習到高階不變性的特征,廣泛應(yīng)用于車牌檢測、人臉檢測、手勢識別、語音識別、圖像復(fù)原和語義分析等領(lǐng)域。目前,CNN算法主要以串行方式實現(xiàn)。串行實現(xiàn)的CNN算法存在兩個主要缺陷：(1)不能發(fā)揮算法內(nèi)在的并行性,導(dǎo)致訓練過程需要較長時間；(2)伸縮性不強,使得不能高效地處理數(shù)據(jù)密集型問題。 谷歌提出的并行編程框架MapReduce具有良好的擴展性和容錯性,成為當前云計算平臺并行處理大規(guī)模數(shù)據(jù)的主流技術(shù)。本文使用MapReduce并行化CNN,并采用GPU加速計算過程,以增強算法的并行性和伸縮性,取得的成果如下： 1.提出利用MapReduce并行化訓練卷積神經(jīng)網(wǎng)絡(luò)的方法(CNN-MR),并部署到Hadoop云計算平臺。CNN-MR采用數(shù)據(jù)并行的分解方法,將訓練樣本劃分給平臺中的每個計算節(jié)點。并使用批量更新的方式,在所有計算節(jié)點處理本地訓練樣本結(jié)束之后,節(jié)點之間做一次通信,得到可訓練參數(shù)在整個訓練集上的全局梯度改變量并更新網(wǎng)絡(luò),多次迭代,至網(wǎng)絡(luò)收斂到設(shè)定閾值或最大迭代次數(shù),算法結(jié)束。 2.提出利用GPU加速CNN-MR算法的方法(CNN-MR-G),并部署到G-Hadoop計算平臺。將CNN每層的特征圖、神經(jīng)元或權(quán)值分別映射到GPU的線程塊、線程,使得同層神經(jīng)元可并行地計算輸出結(jié)果、輸出誤差或權(quán)值的局部梯度改變量。 在手體字數(shù)據(jù)集(MNIST)和自建車牌數(shù)據(jù)集上的實驗表明,CNN-MR算法相對于串行算法具有較好的加速比和伸縮性,CNN-MR-G算法對CNN-MR算法有較好的加速效果。
[Abstract]:Convolutional Neural Networks (CNN); the algorithm can effectively learn high-order invariance features from the original input, and is widely used in license plate detection, face detection, gesture recognition, speech recognition, and so on. Image restoration and semantic analysis. At present, the CNN algorithm is mainly implemented in serial mode. The serial CNN algorithm has two main defects: 1) it can not give full play to the inherent parallelism of the algorithm, which leads to the low scalability of the training process. Makes it impossible to deal with data-intensive problems efficiently. MapReduce, a parallel programming framework proposed by Google, has become the mainstream technology for parallel processing of large scale data in cloud computing platforms due to its good scalability and fault-tolerance. This paper uses MapReduce to parallelize MapReduce and GPU to speed up the computing process. To enhance the parallelism and scalability of the algorithm, the results are as follows:. 1. A method of training convolutional neural network by using MapReduce parallelism is proposed, and deployed to Hadoop cloud computing platform. CNN-MR uses data parallel decomposition method to divide the training samples into each computing node in the platform. After all the computing nodes process the local training samples, the nodes communicate once, get the global gradient change of the trainable parameters on the whole training set, update the network, and iterate many times. To the network convergence to set a threshold or the maximum number of iterations, the algorithm ends. 2. The method of using GPU to accelerate CNN-MR algorithm is put forward and deployed to the G-Hadoop computing platform. The characteristic graph, neuron or weight of each CNN layer are mapped to the thread block and thread of GPU, respectively, so that the same layer neuron can calculate the output results in parallel. The local gradient change of the output error or weight. Experiments on the handwritten character data set (MNIST) and the self-built license plate dataset show that the CNN-MR algorithm has a better speedup and scalability than the serial algorithm in accelerating the CNN-MR algorithm.
【學位授予單位】：鄭州大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TP183;TP338.6

【參考文獻】

相關(guān)期刊論文 前6條

1 張佳康;陳慶奎;;基于CUDA技術(shù)的卷積神經(jīng)網(wǎng)絡(luò)識別算法[J];計算機工程;2010年15期

2 田緒紅;江敏杰;;GPU加速的神經(jīng)網(wǎng)絡(luò)BP算法[J];計算機應(yīng)用研究;2009年05期

3 高曙;基于機群的并行BP算法的設(shè)計與實現(xiàn)[J];武漢理工大學學報(交通科學與工程版);2002年05期

4 曹鋒;周傲英;;基于圖形處理器的數(shù)據(jù)流快速聚類[J];軟件學報;2007年02期

5 趙莉;程榮;;一種并行BP神經(jīng)網(wǎng)絡(luò)的動態(tài)負載平衡方案[J];計算機技術(shù)與發(fā)展;2006年07期

6 楊珂;羅瓊;石教英;;圖形處理器在數(shù)據(jù)庫技術(shù)中的應(yīng)用[J];浙江大學學報(工學版);2009年08期

，

本文編號：1699122