RGB-D特征檢測與描述方法及其應(yīng)用研究
發(fā)布時間：2019-03-11 15:15
【摘要】：局部特征提取通常作為計算機視覺和圖像處理等任務(wù)的第一步,例如:寬基線匹配,圖像拼接以及圖像分類等問題,因此局部特征性能的優(yōu)劣直接影響整個系統(tǒng)最終性能的好壞。隨著RGB-D(depth)傳感器的快速發(fā)展,消費級別的RGB-D攝像機逐漸得到普及。相較于傳統(tǒng)的RGB攝像機,RGB-D攝像機可以直接獲取場景的深度信息,對于提高局部特征的性能有著天然的優(yōu)勢,因此設(shè)計一種高性能的RGB-D局部特征有著非常大的應(yīng)用價值。局部特征提取主要涉及特征檢測、特征描述和特征匹配,孤立研究其中某一內(nèi)容對于局部特征性能的提升是有限的,因此如何合理地利用RGB-D信息構(gòu)建局部特征是一項非常有技巧性的課題。本文主要針對現(xiàn)有的RGB-D描述算子LOIND(Local Ordinal Intensity and Nor-mal Descriptor)[1]進行優(yōu)化,同時提出與其耦合度更高的RGB-D 檢測算子,明顯提升了RGB-D局部特征的性能。為了客觀全面地評測RGB-D局部特征的性能,我們設(shè)計采集了標準的RGB-D局部特征評測數(shù)據(jù)集。本文主要內(nèi)容和成果如下:1.將RGB-D攝像機固定在高精度的機械臂上,完成手眼標定后進行數(shù)據(jù)采集。設(shè)計采集了3大類,15小類的RGB-D數(shù)據(jù)集,包含尺度變換、旋轉(zhuǎn)變換、視角變換以及光照變換,為局部特征研究者提供了極大的便利性。2.將自相關(guān)函數(shù)的思想分別作用于灰度圖和點積圖,從而設(shè)計了一種融合紋理信息和深度信息的RGB-D特征檢測算子,解決了Harris檢測算子[2]在光照變化劇烈時,檢測失敗的問題。同時該檢測算子融合深度信息的方式與LOIND[1]比較一致,因此檢測算子和描述算子的耦合度較高,明顯地提高了 RGB-D局部特征的性能。3.基于點云重投影完成尺度估計和主方向估計,增強了RGB-D局部特征對于尺度變換和旋轉(zhuǎn)變換的魯棒性。同時從算法細節(jié)和代碼兩方面對LOIND[1]描述算子進行優(yōu)化,進而提升RGB-D局部特征算子的時間效率和魯棒性。
[Abstract]:The local feature extraction is usually the first step in the task of computer vision and image processing, such as wide base line matching, image stitching and image classification. With the rapid development of the RGB-D (depth) sensor, the consumption-level RGB-D camera is becoming more and more popular. Compared with the traditional RGB camera, the RGB-D camera can directly acquire the depth information of the scene, and has a natural advantage for improving the performance of the local feature, so that a high-performance RGB-D local characteristic is designed with very large application value. The local feature extraction mainly involves the feature detection, the feature description and the feature matching, and the isolation of some of the content is limited to the enhancement of the local feature performance, so how to use the RGB-D information reasonably to build the local feature is a very technical problem. In this paper, an RGB-D detection operator with higher degree of coupling is proposed, and the performance of the local features of the RGB-D is obviously improved. In order to evaluate the performance of the RGB-D local features in an objective and comprehensive manner, we design a standard RGB-D local feature evaluation data set. The main contents and achievements of this paper are as follows:1. The RGB-D camera is fixed on a high-precision mechanical arm, and after the hand-eye calibration is finished, the data acquisition is carried out. The design and acquisition of the RGB-D data sets of three categories and 15 small classes, including scale transformation, rotation transformation, visual angle transformation and illumination transformation, provide great convenience for the local feature researchers. The concept of self-correlation function is applied to the gray scale graph and the dot product graph respectively, so that an RGB-D characteristic detection operator for fusing the texture information and the depth information is designed, and the problem that the Harris detection operator[2] has failed to detect when the light change is violent is solved. At the same time, the fusion depth information of the detection operator is consistent with the LOIND[1], so the coupling degree of the detection operator and the description operator is high, and the performance of the local characteristic of the RGB-D is obviously improved. The robustness of the local features of the RGB-D to the scale transformation and the rotation transformation is enhanced based on the scale estimation and the main direction estimation of the point cloud re-projection. At the same time, the operator is optimized from the two aspects of the algorithm detail and the code, and the time efficiency and the robustness of the RGB-D local characteristic operator are improved.
【學(xué)位授予單位】：浙江大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP391.41
本文編號：2438391
[Abstract]:The local feature extraction is usually the first step in the task of computer vision and image processing, such as wide base line matching, image stitching and image classification. With the rapid development of the RGB-D (depth) sensor, the consumption-level RGB-D camera is becoming more and more popular. Compared with the traditional RGB camera, the RGB-D camera can directly acquire the depth information of the scene, and has a natural advantage for improving the performance of the local feature, so that a high-performance RGB-D local characteristic is designed with very large application value. The local feature extraction mainly involves the feature detection, the feature description and the feature matching, and the isolation of some of the content is limited to the enhancement of the local feature performance, so how to use the RGB-D information reasonably to build the local feature is a very technical problem. In this paper, an RGB-D detection operator with higher degree of coupling is proposed, and the performance of the local features of the RGB-D is obviously improved. In order to evaluate the performance of the RGB-D local features in an objective and comprehensive manner, we design a standard RGB-D local feature evaluation data set. The main contents and achievements of this paper are as follows:1. The RGB-D camera is fixed on a high-precision mechanical arm, and after the hand-eye calibration is finished, the data acquisition is carried out. The design and acquisition of the RGB-D data sets of three categories and 15 small classes, including scale transformation, rotation transformation, visual angle transformation and illumination transformation, provide great convenience for the local feature researchers. The concept of self-correlation function is applied to the gray scale graph and the dot product graph respectively, so that an RGB-D characteristic detection operator for fusing the texture information and the depth information is designed, and the problem that the Harris detection operator[2] has failed to detect when the light change is violent is solved. At the same time, the fusion depth information of the detection operator is consistent with the LOIND[1], so the coupling degree of the detection operator and the description operator is high, and the performance of the local characteristic of the RGB-D is obviously improved. The robustness of the local features of the RGB-D to the scale transformation and the rotation transformation is enhanced based on the scale estimation and the main direction estimation of the point cloud re-projection. At the same time, the operator is optimized from the two aspects of the algorithm detail and the code, and the time efficiency and the robustness of the RGB-D local characteristic operator are improved.
【學(xué)位授予單位】：浙江大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2017
【分類號】：TP391.41
【參考文獻】
相關(guān)期刊論文 前1條
1 ;Hand-eye calibration with a new linear decomposition algorithm[J];Journal of Zhejiang University(Science A:An International Applied Physics & Engineering Journal);2008年10期
，本文編號：2438391
本文鏈接：http://sikaile.net/kejilunwen/ruanjiangongchenglunwen/2438391.html
最近更新
教材專著
