本文選題：跨媒體 + 語義建模�。� 參考：《北京郵電大學(xué)》2016年碩士論文

【摘要】：目前,互聯(lián)網(wǎng)的飛速發(fā)展給智慧旅游帶來了機遇和挑戰(zhàn),機遇是人們在旅游過程中生產(chǎn)了豐富的跨媒體數(shù)據(jù),挑戰(zhàn)是不同模態(tài)跨媒體數(shù)據(jù)之間的“語義鴻溝”為智慧旅游的發(fā)展造成了很大的障礙。本文針對三個問題進(jìn)行了研究:跨媒體旅游大數(shù)據(jù)的語義分析和建模、基于旅游領(lǐng)域本體知識庫推理的圖像語義內(nèi)容自動標(biāo)注以及融合GIST特征和人群微觀行為特征的擁擠旅游場景內(nèi)容識別。論文完成的主要工作如下:(1)提出了一種基于PLSA主題模型的對稱的建模方法,建立了不同模態(tài)跨媒體數(shù)據(jù)之間的潛在語義關(guān)聯(lián)模型,克服了傳統(tǒng)方法只能表現(xiàn)不同模態(tài)數(shù)據(jù)之間顯式關(guān)系的缺點。通過本文的建模方法,建立了一個包含文本詞和視覺詞之間映射關(guān)系的數(shù)據(jù)模型。(2)提出了一種基于旅游領(lǐng)域本體知識庫推理機制的圖像語義自動標(biāo)注算法。在已經(jīng)建立的跨媒體數(shù)據(jù)語義模型的基礎(chǔ)上,采用融合主題模型的圖像標(biāo)注算法對圖像內(nèi)容進(jìn)行初步標(biāo)注。同時,結(jié)合旅游領(lǐng)域本體知識庫進(jìn)行進(jìn)一步的推理,從而更精確地識別圖像中的內(nèi)容,得到了更加具體的描述圖像內(nèi)容的詞,提高了標(biāo)注效果。通過旅游領(lǐng)域本體知識庫的使用,使標(biāo)注的結(jié)果與具體的景點關(guān)聯(lián)。與傳統(tǒng)的非對稱算法相比,融合語義主題的對稱圖像標(biāo)注算法的圖像標(biāo)注正確率得到了提高。(3)提出了一種融合GIST特征和微觀行為特征的擁擠場景識別方法。對待識別的視頻進(jìn)行鏡頭分割,對每一個鏡頭進(jìn)行背景提取,采用基十GIST特征的場景識別算法對場景進(jìn)行初步判斷,得到初步的識別結(jié)果后,根據(jù)人群移動的規(guī)律提取人群的微觀行為特征,根據(jù)不同場景中人群移動規(guī)律的差異,進(jìn)行再次場景判斷,從而進(jìn)一步提高場景識別的精確程度。該方法實現(xiàn)了針對擁擠旅游場景的有效的場景識別。與傳統(tǒng)的基于GIST特征的場景識別算法相比,融入人群的微觀行為特征以后,實驗結(jié)果的準(zhǔn)確率和召回率得到了進(jìn)一步提高。(4)設(shè)計和實現(xiàn)了跨媒體旅游大數(shù)據(jù)語義學(xué)習(xí)和內(nèi)容識別系統(tǒng),包括跨媒體旅游大數(shù)據(jù)的語義分析和建模、基于旅游領(lǐng)域本體知識庫推理的圖像標(biāo)注、融合GIST特征和微觀行為特征的擁擠場景識別三個模塊。通過該系統(tǒng)對上述每一部分的實驗結(jié)果進(jìn)行了驗證。實驗表明上述算法在旅游跨媒體數(shù)據(jù)語義學(xué)習(xí)和內(nèi)容識別方面具有較好的效果。
[Abstract]:At present, the rapid development of the Internet has brought opportunities and challenges to intelligent tourism. The opportunity is that people produce rich cross-media data in the process of tourism. The challenge is that the semantic gap between different modes and media data causes a great obstacle to the development of intelligent tourism. This paper focuses on three problems: the semantic analysis and modeling of cross-media tourism big data. Image semantic content automatic tagging based on tourism domain ontology knowledge base reasoning and content recognition of crowded tourism scene based on GIST feature and crowd micro behavior feature. The main work of this paper is as follows: (1) A symmetric modeling method based on PLSA topic model is proposed, and the latent semantic association model between different modes of cross-media data is established. It overcomes the shortcoming that the traditional method can only express the explicit relationship between different modal data. Through the modeling method in this paper, a data model containing the mapping relationship between text words and visual words is established. (2) an image semantic automatic annotation algorithm based on the reasoning mechanism of ontology knowledge base in tourism domain is proposed. Based on the established cross-media data semantic model, the image tagging algorithm based on the fusion topic model is used to label the image content. At the same time, combined with the tourism domain ontology knowledge base to further reasoning, thus more accurate recognition of the image content, more specific words to describe the image content, improve the tagging effect. Through the use of ontology knowledge base in tourism field, the results of labeling are associated with specific scenic spots. Compared with the traditional asymmetric algorithm, the accuracy of symmetric image tagging algorithm based on semantic topic is improved. (3) A congestion scene recognition method based on GIST feature and micro behavior feature is proposed. The scene recognition algorithm based on the base ten GIST feature is used to judge the scene, and the initial recognition result is obtained after the scene is segmented by shot segmentation, each shot is extracted from each shot, and the scene recognition algorithm based on the base 10 GIST feature is used to judge the scene. According to the law of crowd movement, the micro-behavior characteristics of the crowd are extracted, and the accuracy of scene recognition is further improved by judging the scene again according to the difference of the law of crowd movement in different scenes. This method realizes the effective scene recognition for the crowded tourist scene. Compared with the traditional scene recognition algorithm based on GIST feature, after the microcosmic behavior of the crowd is merged, The accuracy and recall rate of the experimental results are further improved. (4) A cross-media tourism big data semantic learning and content recognition system is designed and implemented, including semantic analysis and modeling of cross-media tourism big data. There are three modules: image annotation based on ontology knowledge base reasoning in tourism domain, and congestion scene recognition based on GIST feature and micro behavior feature. The experimental results of each part are verified by the system. Experiments show that the algorithm is effective in semantic learning and content recognition of travel data across media.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2016
【分類號】：TP391.41

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 仲濟源;梅魁志;溫哲西;;GIST特征提取的異構(gòu)并發(fā)流計算實現(xiàn)[J];計算機工程與應(yīng)用;2015年06期

2 管飛;王榮;;基于Horn-Schunck光流法的運動目標(biāo)檢測的研究[J];儀表技術(shù);2015年02期

3 莊福振;羅平;何清;史忠植;;遷移學(xué)習(xí)研究進(jìn)展[J];軟件學(xué)報;2015年01期

4 熊英;;基于背景和幀間差分法的運動目標(biāo)提取[J];計算機時代;2014年03期

5 楊昭;高雋;謝昭;吳克偉;;局部Gist特征匹配核的場景分類[J];中國圖象圖形學(xué)報;2013年03期

6 徐如意;陳靚影;;稀疏表示的Lucas-Kanade目標(biāo)跟蹤[J];中國圖象圖形學(xué)報;2013年03期

7 周麗娟;王慧;王文伯;張寧;;面向海量數(shù)據(jù)的并行KMeans算法[J];華中科技大學(xué)學(xué)報(自然科學(xué)版);2012年S1期

8 張凌云;黎]，

本文編號：1777505