本文選題：Dom樹 + Htmlparser�。� 參考：《大連理工大學(xué)》2012年碩士論文

【摘要】：隨著新興移動(dòng)終端的飛速發(fā)展,其優(yōu)秀的操控體驗(yàn)并攜帶多種傳感器,使人們隨時(shí)隨地的獲取更多的信息。隨之移動(dòng)互聯(lián)網(wǎng)成為人們生活中不可或缺的一部分,人們的工作、學(xué)習(xí)、生活、娛樂(lè)都將依賴著移動(dòng)互聯(lián)網(wǎng),人們開始更多的在終端設(shè)備上獲取信息。但是部分中低端手機(jī)不能瀏覽Html頁(yè)面,即使可以瀏覽也因?yàn)閃EB頁(yè)面是為PC設(shè)計(jì)的,因此在移動(dòng)終端上瀏覽體驗(yàn)極差、頁(yè)面較大,用戶訪問(wèn)流量、時(shí)間、帶寬成本較大。 因此如何將Html頁(yè)面轉(zhuǎn)換成適合在移動(dòng)終端上瀏覽的頁(yè)面,為眾多的移動(dòng)終端應(yīng)用或移動(dòng)搜索引擎提供低成本、快速、有良好瀏覽體驗(yàn)的網(wǎng)頁(yè)信息瀏覽能力有著極其重要意義,是支持移動(dòng)互聯(lián)網(wǎng)和傳統(tǒng)互聯(lián)網(wǎng)信息融合的關(guān)鍵。本文針對(duì)上述問(wèn)題提出了一種服務(wù)器端網(wǎng)頁(yè)轉(zhuǎn)換系統(tǒng)。系統(tǒng)將Html頁(yè)面轉(zhuǎn)換為XHtml頁(yè)面,打破了部分手機(jī)不能瀏覽Html頁(yè)面的技術(shù)性限制。更重要的是系統(tǒng)將對(duì)網(wǎng)頁(yè)內(nèi)容進(jìn)行解析、識(shí)別,過(guò)濾不需要的內(nèi)容,重新對(duì)網(wǎng)頁(yè)進(jìn)行排版、適配和分頁(yè),對(duì)圖片進(jìn)行壓縮處理,最后拼接整個(gè)頁(yè)面返回給用戶,該網(wǎng)頁(yè)的版式、內(nèi)容、布局和展現(xiàn)效果更適合移動(dòng)終端。 文中詳細(xì)闡述了系統(tǒng)的總體方案、詳細(xì)設(shè)計(jì)和實(shí)現(xiàn),為了配合網(wǎng)頁(yè)轉(zhuǎn)換的實(shí)時(shí)和高效,系統(tǒng)主要設(shè)計(jì)了前端模塊、緩存模塊、抓取模塊和轉(zhuǎn)換模塊,前端模塊負(fù)責(zé)解析用戶請(qǐng)求和各個(gè)模塊的網(wǎng)絡(luò)交互。在收到用戶請(qǐng)求后將對(duì)頁(yè)面進(jìn)行實(shí)時(shí)抓取,然后交給后端進(jìn)行網(wǎng)頁(yè)轉(zhuǎn)換以實(shí)現(xiàn)實(shí)時(shí)轉(zhuǎn)換的功能。系統(tǒng)中加入了緩存模塊,使重復(fù)請(qǐng)求有快速響應(yīng)處理,并且系統(tǒng)采用異步框架實(shí)現(xiàn),提高系統(tǒng)的處理性能。在實(shí)現(xiàn)系統(tǒng)后進(jìn)行測(cè)試,結(jié)果表明滿足上述設(shè)計(jì)要求,并進(jìn)行大量的手工轉(zhuǎn)換測(cè)試,85%以上的頁(yè)面展現(xiàn)效果良好,版式合理,頁(yè)面壓縮率高達(dá)76%,平均一次請(qǐng)求處理時(shí)間在500ms以內(nèi),緩存命中率23.85%,經(jīng)每秒100個(gè)請(qǐng)求的壓力測(cè)試,系統(tǒng)資源占用合理、程序穩(wěn)定,符合設(shè)計(jì)需求,給用戶帶來(lái)低成本、快速卓越的瀏覽體驗(yàn),使人們更便捷地隨時(shí)隨地獲取信息找到所求。
[Abstract]:With the rapid development of new mobile terminals, its excellent control experience and carry a variety of sensors, so that people can get more information anytime and anywhere. With this, mobile Internet becomes an indispensable part of people's life, people's work, study, life, entertainment will depend on mobile Internet, people begin to get more information on terminal devices. However, some low-end mobile phones can not browse Html pages, even if they can browse, because WEB pages are designed for PC, so the browsing experience on mobile terminals is extremely poor, the pages are large, user access traffic, time, bandwidth cost is high. Therefore, how to convert Html pages into pages suitable for browsing on mobile terminals is of great significance in providing low-cost, fast and good browsing experience for many mobile terminal applications or mobile search engines. Is the support mobile Internet and the traditional Internet information fusion key. In this paper, a server-side web page conversion system is proposed to solve the above problems. The system transforms Html page into XHtml page, breaking the technical restriction that some mobile phone can't browse Html page. What is more important is that the system will parse, identify, filter the unwanted content of the web page, rearrange, adapt and paginate the page, compress the picture, and finally splice the whole page back to the user, the layout of the page. Content, layout and presentation effects are more suitable for mobile terminals. In this paper, the overall scheme, design and implementation of the system are described in detail. In order to cooperate with the real time and high efficiency of web page conversion, the system mainly designs front-end module, cache module, grab module and conversion module. The front-end module is responsible for parsing the user request and the network interaction of each module. After receiving the user's request, the page will be fetched in real time, and then transferred to the back end to realize the function of real-time conversion. The cache module is added to the system to make the repeated requests respond quickly and the asynchronous framework is adopted to improve the processing performance of the system. After the implementation of the system, the test results show that the above design requirements are satisfied, and a large number of manual conversion tests are carried out with 85% of the pages showing good results, reasonable layout, the compression ratio of the page is as high as 76%, and the average processing time of one request is less than 500ms. Cache hit rate 23.85, after 100 requests per second of the stress test, the system resources use is reasonable, the program is stable, meet the design needs, bring users low-cost, rapid and excellent browsing experience, Make it easier for people to get information at any time and anywhere to find out what they want.
【學(xué)位授予單位】：大連理工大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TN929.53;TP393.092

【引證文獻(xiàn)】

相關(guān)碩士學(xué)位論文 前1條

1 楊同江;基于中間件的移動(dòng)多媒體終端技術(shù)的研究與實(shí)現(xiàn)[D];北京郵電大學(xué);2013年

，

本文編號(hào)：1870003