本文關鍵詞：基于云計算的海量高鐵噪聲數(shù)據(jù)并行處理方法研究　出處：《西南交通大學》2013年碩士論文　論文類型：學位論文

  更多相關文章： 并行濾波 并行預處理 MapReduce 高速鐵路 噪聲

【摘要】：隨著高速鐵路的飛速發(fā)展,高速鐵路的安全與舒適成為當前研究的一個熱點問題。安裝在列車上的傳感器采集的噪聲數(shù)據(jù)反映了列車的運行狀況,并與列車的安全息息相關。然而在噪聲數(shù)據(jù)采集的過程中由于種種因素的影響,采集的列車噪聲數(shù)據(jù)中含有不同頻率和特點的干擾數(shù)據(jù),干擾數(shù)據(jù)直接影響了數(shù)據(jù)的分析與處理。研究表明預處理和濾波處理可以有效地去除數(shù)據(jù)中的干擾數(shù)據(jù)。然而,隨著采集的數(shù)據(jù)量越來越大,而傳統(tǒng)的預處理與濾波方法均采用的是單機處理的方式,效率低下,無法滿足實際需求。云計算技術是解決上述難題的一項關鍵技術,其中的MapReduce模型可用于大規(guī)模數(shù)據(jù)的并行運算,由于其良好的并行效果且不用了解其底層架構,目前已有很多學者利用MapReduce進行算法設計,且取得了良好的成果。因此本文擬將云計算技術應用到預處理與濾波方法中以提高列車噪聲數(shù)據(jù)處理的效率,具有重要的實際應用價值。 本文首先對預處理、濾波和云計算的國內外研究現(xiàn)狀進行介紹。然后概述云計算技術與預處理方法,研究了預處理方法的并行化,提出了基于MapReduce的海量高鐵噪聲數(shù)據(jù)并行預處理算法,用Speedup和Sizeup并行化指標來評價算法的性能,實驗結果表明并行預處理算法性能提升顯著。緊接著,討論了高通濾波、低通濾波、動窗濾波和中位值濾波等傳統(tǒng)濾波技術,并對濾波方法進行并行化改進,提出基于MapReduce的海量高鐵噪聲數(shù)據(jù)并行濾波算法。波形展示和濾波正確性實驗分析表明濾波效果明顯。信噪比和均方差實驗給出了高通濾波和低通濾波的最佳濾波參數(shù)。采用Speedup、 Sizeup和Scaleup這三個并行化參數(shù)評價并行濾波算法的性能,結果表明本文所提出的并行動窗濾波和并行中位值濾波算法性能提升顯著；并行高通濾波和并行低通濾波算法由于使用了公共變量和受算法自身時間復雜度影響,并行效果受到一定影響。
[Abstract]:With the rapid development of high-speed railway, high-speed railway safety and comfort has become a hot issue in current research. The noise data collected by sensors installed on the train to reflect the running status of the trains, and is closely related to the safety of the train. However, due to various factors in the process of noise data acquisition, the data of different frequency interference and the characteristics of the noise data collected in the train with the interference data directly affects the data processing and analysis. The results indicate that the preprocessing and filtering can effectively remove the interference data. However, with the increasing of the data, while pretreatment with the traditional filtering methods are used is single the way, efficiency is low, can not meet the actual demand. Cloud computing is a key technology to solve the above problems, the MapReduce model can be used for large scale Parallel computing data, due to its good parallel efficiency and do not know the underlying architecture, many researchers have applied MapReduce to design algorithm, and achieved good results. So this thesis intends to apply cloud computing technology to pretreatment and filtering to improve the noise data processing efficiency, has important practical application value.
Firstly, preprocessing, research actuality of filtering and cloud computing. Then an overview of cloud computing technology and pretreatment methods, the study of parallel preprocessing methods, proposes a parallel preprocessing algorithm for high-speed railway noise data based on MapReduce, to evaluate the performance of the algorithm by using Speedup and Sizeup parallel index and the experiment results show that the parallel preprocessing algorithm performance significantly. Then, the high pass filter, low-pass filter, dynamic filtering technology of traditional filtering median filtering and window, and the filtering method is improved by parallel computing, parallel filtering algorithm proposed high-speed railway noise data based on MapReduce waveform display and filtering the correct. Experimental analysis shows that the filtering effect is obvious. The signal-to-noise ratio and the mean variance experiment provides the optimum filtering parameters of high pass filter and low-pass filter. By using Speedup, Sizeup and Scaleup three The performance evaluation parameters of parallel parallel filtering algorithm, the results show that the proposed median filtering algorithm and performance improvement action window filtering and parallel in parallel; parallel high pass filter and low pass filtering algorithm due to the use of public variables and time complexity of the algorithm itself, parallel effect affected.

【學位授予單位】：西南交通大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TN911.4;TP338.6

【參考文獻】

相關期刊論文 前10條

1 張嬋;宋凱;;小波模極大值去噪法在多元探測器弱信號檢測中的應用[J];彈箭與制導學報;2004年S6期

2 趙鈞;;構建基于云計算的物聯(lián)網運營平臺[J];電信科學;2010年06期

3 劉勝杰;李媛;;最小均方差算法在智能天線非盲波束形成中的應用[J];電子測量技術;2007年01期

4 孫苗鐘;;基于MATLAB的振動信號平滑處理方法[J];電子測量技術;2007年06期

5 陳鵬;楊理踐;高松巍;;有限沖擊響應數(shù)字濾波器的DSP實現(xiàn)[J];電子質量;2008年05期

6 李輝;朱建華;薛寵;張蕾;高海榮;;Kalman濾波在GPS授時中的應用[J];甘肅科學學報;2011年03期

7 陳燕;劉哲;鄭賓;;基于LabVIEW的測試信號預處理方法研究[J];國外電子測量技術;2008年10期

8 馬宗峰;張春熹;張朝陽;顏廷洋;;光學外差探測信噪比研究[J];光學學報;2007年05期

9 陸吉斌;;通用中位值平均濾波法PLC程序的設計與實現(xiàn)[J];計算機光盤軟件與應用;2012年11期

10 王一海;俞筱楠;姜志鵬;;并行分布式算法FIR濾波器的FPGA實現(xiàn)[J];電子器件;2012年05期

相關博士學位論文 前1條

1 夏驕雄;數(shù)據(jù)資源聚類預處理及其應用研究[D];上海大學;2007年

，

本文編號：1382464