本文關(guān)鍵詞： 流程工業(yè) 分布式實(shí)時(shí)數(shù)據(jù)庫(kù) 分布式自組織理論 動(dòng)態(tài)存儲(chǔ)全局索引機(jī)制 分布式并行處理框架　出處：《浙江大學(xué)》2016年博士論文　論文類型：學(xué)位論文

【摘要】：隨著產(chǎn)業(yè)結(jié)構(gòu)優(yōu)化和集中度提升,流程工業(yè)企業(yè)的生產(chǎn)規(guī)模不斷擴(kuò)大,傳統(tǒng)的集中式實(shí)時(shí)數(shù)據(jù)庫(kù)由于數(shù)據(jù)吞吐量不足、投資成本過(guò)高、容錯(cuò)能力較低、難以彈性擴(kuò)展等問(wèn)題,已無(wú)法滿足實(shí)際應(yīng)用需求。針對(duì)上述問(wèn)題,本論文將大規(guī)模分布式系統(tǒng)設(shè)計(jì)思想與實(shí)時(shí)性、可靠性技術(shù)相結(jié)合,建立流程工業(yè)分布式實(shí)時(shí)數(shù)據(jù)庫(kù)的服務(wù)模型,研究海量數(shù)據(jù)的動(dòng)態(tài)存儲(chǔ)索引機(jī)制、事務(wù)建模與并行處理、高可用性網(wǎng)絡(luò)實(shí)時(shí)通信等技術(shù),并實(shí)現(xiàn)研究成果在實(shí)際工業(yè)項(xiàng)目中的應(yīng)用驗(yàn)證。具體理論研究和技術(shù)應(yīng)用成果如下:(1)在對(duì)流程工業(yè)應(yīng)用場(chǎng)景的需求特點(diǎn)進(jìn)行深入分析的基礎(chǔ)上,提出了分布式實(shí)時(shí)數(shù)據(jù)庫(kù)的服務(wù)模型作為系統(tǒng)的基礎(chǔ)架構(gòu),以及基于中心化組織結(jié)構(gòu)和中心節(jié)點(diǎn)主從機(jī)制的實(shí)時(shí)數(shù)據(jù)庫(kù)分布式自組織理論。提出了基于Raft協(xié)議的主從中心節(jié)點(diǎn)選舉策略,結(jié)合服務(wù)發(fā)現(xiàn)模型、服務(wù)部署策略的研究與設(shè)計(jì),實(shí)現(xiàn)了實(shí)時(shí)數(shù)據(jù)庫(kù)服務(wù)內(nèi)部與系統(tǒng)整體兩個(gè)層級(jí)的自組織。(2)針對(duì)流程工業(yè)的存儲(chǔ)應(yīng)用場(chǎng)景特點(diǎn),提出了基于工廠邏輯模型的動(dòng)態(tài)全局索引機(jī)制,以及基于二級(jí)分頁(yè)和多版本管理的本地索引機(jī)制。重點(diǎn)對(duì)數(shù)據(jù)分區(qū)分片策略、節(jié)點(diǎn)增刪處理方案、數(shù)據(jù)多重副本機(jī)制和存檔文件壓縮方案進(jìn)行了研究,解決了異常狀態(tài)下數(shù)據(jù)擬合錯(cuò)誤和歷史數(shù)據(jù)占用磁盤空間過(guò)高的問(wèn)題,實(shí)現(xiàn)了存儲(chǔ)系統(tǒng)的可靠性和擴(kuò)展能力。(3)深入分析流程工業(yè)分布式任務(wù)請(qǐng)求的特點(diǎn),建立了分布式實(shí)時(shí)數(shù)據(jù)庫(kù)的事務(wù)模型。基于該模型,研究并實(shí)現(xiàn)了相應(yīng)的分布式并行查詢模型和分布式并行計(jì)算服務(wù),用于解決分布式事務(wù)處理面臨的事務(wù)分解、并行調(diào)度、資源管理等問(wèn)題。提出了分布式實(shí)時(shí)混合并發(fā)控制算法,綜合利用多版本并發(fā)控制與樂(lè)觀并發(fā)控制的無(wú)阻塞特性,能夠優(yōu)化分布式事務(wù)執(zhí)行的實(shí)時(shí)性。(4)提出了高可用性網(wǎng)絡(luò)實(shí)時(shí)通信服務(wù)的層次結(jié)構(gòu),通過(guò)冗余連接會(huì)話、數(shù)據(jù)轉(zhuǎn)發(fā)通道、網(wǎng)絡(luò)服務(wù)自組織等多種機(jī)制和策略,提高了流程工業(yè)網(wǎng)絡(luò)的可用性。設(shè)計(jì)了針對(duì)流程工業(yè)網(wǎng)絡(luò)的時(shí)鐘同步機(jī)制,能夠有效處理網(wǎng)絡(luò)時(shí)延抖動(dòng)和服務(wù)器單點(diǎn)失效問(wèn)題。同時(shí),提出了網(wǎng)絡(luò)傳輸數(shù)據(jù)加密保護(hù)方案和基于數(shù)字證書的用戶身份認(rèn)證機(jī)制,提升了網(wǎng)絡(luò)信息安全水平。本論文完成的研究成果有效地解決了流程工業(yè)實(shí)時(shí)數(shù)據(jù)庫(kù)的基礎(chǔ)架構(gòu)、大容量、實(shí)時(shí)性、可用性、并發(fā)訪問(wèn)等難點(diǎn)問(wèn)題,并通過(guò)系統(tǒng)測(cè)試和實(shí)際應(yīng)用案例驗(yàn)證了其功能和性能指標(biāo)項(xiàng),應(yīng)用結(jié)果表明本論文的研究成果能夠滿足大規(guī)模流程工業(yè)生產(chǎn)的實(shí)際需求。
[Abstract]:With the optimization of industrial structure and enhance the degree of concentration, enterprise production scale is expanding constantly, the traditional centralized real-time database due to insufficient data throughput, the investment cost is too high, fault tolerance is low, it is difficult to elastic expansion and other issues, has been unable to meet the needs of practical application. To solve the above problems, this paper will design and real-time large-scale distributed systems reliability, technology, service model of distributed process industrial real-time database, dynamic indexing mechanism of massive data storage, parallel processing and transaction modeling, high availability network real-time communication technology, and realizes the application of the research results are verified in actual industrial projects. The specific theoretical research and technical application of the results are as follows: (1) in-depth analysis based on the demand characteristics of the application of process industry, put forward a distributed real-time database Service model as the basis for the system architecture, and distributed real-time database structure and mechanism of the center center master-slave node based on self-organization theory. Proposed master-slave center node selection strategy based on Raft protocol, combined with the model of service discovery, service deployment research and design strategy, realize the self organization internal and overall system real-time database service two a level. (2) for storage application scenarios of the characteristics of process industry, put forward the dynamic global indexing mechanism based on logical model of plant, and based on the local index system of two level paging and multi version management. Focusing on the data partition strategy, data processing scheme of node deletions, multiple copy mechanism and archive file compression scheme the study, to solve the problem of high disk space occupied under abnormal condition, data fitting error and historical data, realize the storage system System reliability and scalability. (3) analyzes the characteristics of distributed task process industry request, established the transaction model of distributed real-time database. Based on this model, the research and implementation of the corresponding distributed parallel query service and distributed parallel computing model, is used to solve the distributed transaction processing face transaction decomposition, parallel scheduling, resource management other issues. We put forward a real-time hybrid concurrency control algorithm for distributed, comprehensive utilization of multi version concurrency control and optimistic concurrency control of non blocking characteristics, to optimize the distributed transaction execution in real time. (4) put forward a hierarchical structure of real-time communication service high availability network connection, session through redundancy, data transmission channel, network service self organization and other mechanisms and strategies to improve the availability of network of process industry. The design of clock synchronization mechanism for the network process industry, can Enough to effectively deal with network delay jitter and server failure problem. At the same time, the network transmission of data encryption scheme and user identity authentication mechanism based on digital certificate, enhance network information security level. The results of this study can effectively solve the completed infrastructure, process industrial real-time database capacity, real-time, availability, concurrency and other difficult problems, and through the system test and practical application verifies the function and performance indexes. The application results show that the research results of this paper can satisfy the actual demand of large-scale industrial production process.

【學(xué)位授予單位】：浙江大學(xué)
【學(xué)位級(jí)別】：博士
【學(xué)位授予年份】：2016
【分類號(hào)】：TP311.13

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 張朝昆;崔勇;唐，

本文編號(hào)：1505131