本文關鍵詞： 流程工業(yè) 分布式實時數(shù)據庫 分布式自組織理論 動態(tài)存儲全局索引機制 分布式并行處理框架　出處：《浙江大學》2016年博士論文　論文類型：學位論文

【摘要】：隨著產業(yè)結構優(yōu)化和集中度提升,流程工業(yè)企業(yè)的生產規(guī)模不斷擴大,傳統(tǒng)的集中式實時數(shù)據庫由于數(shù)據吞吐量不足、投資成本過高、容錯能力較低、難以彈性擴展等問題,已無法滿足實際應用需求。針對上述問題,本論文將大規(guī)模分布式系統(tǒng)設計思想與實時性、可靠性技術相結合,建立流程工業(yè)分布式實時數(shù)據庫的服務模型,研究海量數(shù)據的動態(tài)存儲索引機制、事務建模與并行處理、高可用性網絡實時通信等技術,并實現(xiàn)研究成果在實際工業(yè)項目中的應用驗證。具體理論研究和技術應用成果如下:(1)在對流程工業(yè)應用場景的需求特點進行深入分析的基礎上,提出了分布式實時數(shù)據庫的服務模型作為系統(tǒng)的基礎架構,以及基于中心化組織結構和中心節(jié)點主從機制的實時數(shù)據庫分布式自組織理論。提出了基于Raft協(xié)議的主從中心節(jié)點選舉策略,結合服務發(fā)現(xiàn)模型、服務部署策略的研究與設計,實現(xiàn)了實時數(shù)據庫服務內部與系統(tǒng)整體兩個層級的自組織。(2)針對流程工業(yè)的存儲應用場景特點,提出了基于工廠邏輯模型的動態(tài)全局索引機制,以及基于二級分頁和多版本管理的本地索引機制。重點對數(shù)據分區(qū)分片策略、節(jié)點增刪處理方案、數(shù)據多重副本機制和存檔文件壓縮方案進行了研究,解決了異常狀態(tài)下數(shù)據擬合錯誤和歷史數(shù)據占用磁盤空間過高的問題,實現(xiàn)了存儲系統(tǒng)的可靠性和擴展能力。(3)深入分析流程工業(yè)分布式任務請求的特點,建立了分布式實時數(shù)據庫的事務模型。基于該模型,研究并實現(xiàn)了相應的分布式并行查詢模型和分布式并行計算服務,用于解決分布式事務處理面臨的事務分解、并行調度、資源管理等問題。提出了分布式實時混合并發(fā)控制算法,綜合利用多版本并發(fā)控制與樂觀并發(fā)控制的無阻塞特性,能夠優(yōu)化分布式事務執(zhí)行的實時性。(4)提出了高可用性網絡實時通信服務的層次結構,通過冗余連接會話、數(shù)據轉發(fā)通道、網絡服務自組織等多種機制和策略,提高了流程工業(yè)網絡的可用性。設計了針對流程工業(yè)網絡的時鐘同步機制,能夠有效處理網絡時延抖動和服務器單點失效問題。同時,提出了網絡傳輸數(shù)據加密保護方案和基于數(shù)字證書的用戶身份認證機制,提升了網絡信息安全水平。本論文完成的研究成果有效地解決了流程工業(yè)實時數(shù)據庫的基礎架構、大容量、實時性、可用性、并發(fā)訪問等難點問題,并通過系統(tǒng)測試和實際應用案例驗證了其功能和性能指標項,應用結果表明本論文的研究成果能夠滿足大規(guī)模流程工業(yè)生產的實際需求。
[Abstract]:With the optimization of industrial structure and enhance the degree of concentration, enterprise production scale is expanding constantly, the traditional centralized real-time database due to insufficient data throughput, the investment cost is too high, fault tolerance is low, it is difficult to elastic expansion and other issues, has been unable to meet the needs of practical application. To solve the above problems, this paper will design and real-time large-scale distributed systems reliability, technology, service model of distributed process industrial real-time database, dynamic indexing mechanism of massive data storage, parallel processing and transaction modeling, high availability network real-time communication technology, and realizes the application of the research results are verified in actual industrial projects. The specific theoretical research and technical application of the results are as follows: (1) in-depth analysis based on the demand characteristics of the application of process industry, put forward a distributed real-time database Service model as the basis for the system architecture, and distributed real-time database structure and mechanism of the center center master-slave node based on self-organization theory. Proposed master-slave center node selection strategy based on Raft protocol, combined with the model of service discovery, service deployment research and design strategy, realize the self organization internal and overall system real-time database service two a level. (2) for storage application scenarios of the characteristics of process industry, put forward the dynamic global indexing mechanism based on logical model of plant, and based on the local index system of two level paging and multi version management. Focusing on the data partition strategy, data processing scheme of node deletions, multiple copy mechanism and archive file compression scheme the study, to solve the problem of high disk space occupied under abnormal condition, data fitting error and historical data, realize the storage system System reliability and scalability. (3) analyzes the characteristics of distributed task process industry request, established the transaction model of distributed real-time database. Based on this model, the research and implementation of the corresponding distributed parallel query service and distributed parallel computing model, is used to solve the distributed transaction processing face transaction decomposition, parallel scheduling, resource management other issues. We put forward a real-time hybrid concurrency control algorithm for distributed, comprehensive utilization of multi version concurrency control and optimistic concurrency control of non blocking characteristics, to optimize the distributed transaction execution in real time. (4) put forward a hierarchical structure of real-time communication service high availability network connection, session through redundancy, data transmission channel, network service self organization and other mechanisms and strategies to improve the availability of network of process industry. The design of clock synchronization mechanism for the network process industry, can Enough to effectively deal with network delay jitter and server failure problem. At the same time, the network transmission of data encryption scheme and user identity authentication mechanism based on digital certificate, enhance network information security level. The results of this study can effectively solve the completed infrastructure, process industrial real-time database capacity, real-time, availability, concurrency and other difficult problems, and through the system test and practical application verifies the function and performance indexes. The application results show that the research results of this paper can satisfy the actual demand of large-scale industrial production process.

【學位授予單位】：浙江大學
【學位級別】：博士
【學位授予年份】：2016
【分類號】：TP311.13

【參考文獻】

相關期刊論文 前10條

1 張朝昆;崔勇;唐，

本文編號：1505131