本文選題：智慧家庭 + 多模態(tài)人機(jī)交互�。� 參考：《東北大學(xué)》2012年碩士論文

【摘要】：隨著計(jì)算機(jī)及其相關(guān)技術(shù)的發(fā)展和人們生活水平的不斷提高,人們對計(jì)算機(jī)的要求不再是網(wǎng)上沖浪、辦公、娛樂等,而是希望它能用于家庭生活的方方面面,例如：家電控制、室內(nèi)環(huán)境控制等,因而家庭生活的智能化成為了家庭生活發(fā)展的必然趨勢。 目前,圖形化界面人機(jī)交互方式是應(yīng)用于人與計(jì)算機(jī)交互的主要方式,雖然這種方式已經(jīng)達(dá)到對設(shè)備的有效控制,但是人們的感受作為評價(jià)交互方式優(yōu)劣的重要因素沒有考慮在內(nèi),對操作人員的素質(zhì)要求也比較高,尤其是殘障人士根本無法使用該系統(tǒng),致使用戶與計(jì)算機(jī)的交互過程中存在很大的局限�；谶@些原因,本文提出了一種更適合用戶與系統(tǒng)交互的方式,即多模態(tài)人機(jī)交互方式。針對智慧家庭系統(tǒng),設(shè)計(jì)并實(shí)現(xiàn)了多模態(tài)的人機(jī)交互模塊和智慧家庭系統(tǒng)的資源配置模塊,其貢獻(xiàn)點(diǎn)可以概括如下： (1)在配置界面顯示上采用了XML技術(shù),并擴(kuò)展了XML和：XML Schema的傳統(tǒng)用途,即在XML中增添界面顯示元素,通過XML轉(zhuǎn)換器把XML轉(zhuǎn)換成界面元素,用于界面顯示；通過：XML Schema轉(zhuǎn)換器把XML Schema轉(zhuǎn)換成XML元素模板,再通過XML轉(zhuǎn)換器把XML元素模板轉(zhuǎn)換成半界面元素。XML與XML Schema新的用途適用于智慧家庭資源配置,增加了界面顯示的靈活性。 (2)設(shè)計(jì)了具有擴(kuò)展能力的人機(jī)交互輸入接口,并對其進(jìn)行了多種實(shí)現(xiàn),如：語音輸入實(shí)現(xiàn)、電話語音輸入實(shí)現(xiàn)、MSN輸入實(shí)現(xiàn)、Gtalk輸入實(shí)現(xiàn)、Skype輸入實(shí)現(xiàn)和Google日歷輸入實(shí)現(xiàn)。人機(jī)交互輸入接口方便了輸入方式的擴(kuò)展,流行IM輸入和日歷輸入實(shí)現(xiàn)充分考慮用戶的行為習(xí)慣,方便用戶對計(jì)算機(jī)的控制。 (3)設(shè)計(jì)了具有擴(kuò)展能力的人機(jī)交互輸出接口,并對其進(jìn)行了多種實(shí)現(xiàn),如：文字轉(zhuǎn)換語音輸出實(shí)現(xiàn)、命令控制輸出實(shí)現(xiàn)和視頻輸出實(shí)現(xiàn)。人機(jī)交互輸出接口方便了輸出方式的擴(kuò)展。 (4)設(shè)計(jì)實(shí)現(xiàn)了智慧家庭的配置模塊,主要包括系統(tǒng)信息資源、家庭用戶資源、硬件資源的配置和軟件資源的配置,硬件資源包括：房間、設(shè)備的配置；軟件資源包括：瀏覽器、鼠標(biāo)、新聞播報(bào)和控制設(shè)備指令的配置。配置模塊為資源變更提供了較強(qiáng)的伸縮空間,方便了用戶對家中資源的管理。
[Abstract]:With the development of computer and its related technology and the improvement of people's living standard, people's demand for computer is no longer surfing, office, entertainment and so on, but hoping that it can be used in all aspects of family life, such as: home appliance control, etc. Indoor environment control, so the intelligent family life has become an inevitable trend of family life development. At present, the graphical interface human-computer interaction is the main way to apply to human and computer interaction, although this way has achieved the effective control of the device, However, people's feelings are not taken into account as an important factor in evaluating the merits and demerits of interaction methods, and the quality of the operators is also quite high, especially for the disabled who simply cannot use the system. The interaction between the user and the computer is very limited. For these reasons, this paper proposes a more suitable way for user to interact with the system, that is, multimodal human-computer interaction. The multi-modal man-machine interaction module and the intelligent family system resource allocation module are designed and implemented for the intelligent family system. The contribution points can be summarized as follows: 1) using XML technology in configuration interface display, and extending the traditional use of XML and: XML Schema, that is, adding interface display element in XML, converting XML into interface element through XML converter for interface display; The XML Schema is converted into XML element template by the XML Schema converter, and the XML element template is converted into the half interface element by XML converter. The new uses of XML element template and XML Schema are suitable for the intelligent family resource configuration, which increases the flexibility of interface display. (2) the man-machine interactive input interface with extended capability is designed and implemented, such as voice input, telephone voice input, Google input and Google calendar input. The man-machine interactive input interface facilitates the expansion of the input mode. The popular IM input and calendar input implement fully consider the user's behavior habits and facilitate the user's control of the computer. 3) the man-machine interactive output interface with extended ability is designed and implemented, such as: text conversion speech output, command control output and video output. The man-machine interactive output interface facilitates the expansion of the output mode. 4) the configuration module of intelligent family is designed and implemented, including system information resource, home user resource, hardware resource configuration and software resource configuration, hardware resource including room, equipment configuration, software resource including browser, Mouse, news broadcast and control device command configuration. The configuration module provides a strong expansion space for resource change and facilitates the user to manage the resources at home.
【學(xué)位授予單位】：東北大學(xué)
【學(xué)位級別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP11;TP334.7

【參考文獻(xiàn)】

相關(guān)期刊論文 前4條

1 鄧偉志;葉治安;;世界老齡化:一場靜悄悄的革命——關(guān)于“銀發(fā)浪潮”的世紀(jì)對話[J];上海城市管理;2011年03期

2 黃程韋;金峗;王青云;趙力;鄒采榮;;基于語音信號(hào)與心電信號(hào)的多模態(tài)情感識(shí)別[J];東南大學(xué)學(xué)報(bào)(自然科學(xué)版);2010年05期

3 吳麗萍;李亞潔;;行為轉(zhuǎn)變理論在不良生活方式干預(yù)中的應(yīng)用進(jìn)展[J];護(hù)理學(xué)報(bào);2009年15期

4 呂萍;鐘亮;;基于覺察上下文計(jì)算的健康智能家庭研究[J];計(jì)算機(jī)工程與設(shè)計(jì);2009年21期

，

本文編號(hào)：1810169