Data acquisition and processing platform for internet of things analysis and control

Abstract

A data acquisition and processing platform system for Industrial Internet of Things (IIoT) analysis and control, the system configured to receive data from a plurality of data sources having data streams with different properties, the system having an architecture comprising a plurality of platform installations, each installation comprising a node, and the system comprising: a data ingestion subsystem having a plurality of data receivers, each of the plurality of data receivers adapted to acquire data from specific data sources; a routing subsystem and a message bus subsystem, the routing and message bus subsystems together forming a communication backbone of the system; a signal identification subsystem, closely interconnected with a data processing subsystem, and configured to form a separate data stream of alarms; and a user interface (UI) backend, configured to provide front-end applications, including information and actionable insights to the end users; wherein the system architecture is scalable and reliable and configured for continuous handling of data streaming from various data sources.

The invention claimed is: 
     
       1. A data acquisition and processing platform system for Industrial Internet of Things (IIoT) analysis and control, the system configured to receive data from a plurality of data sources having data streams with different properties, the system having a microservice, fault tolerant, and scalable architecture comprising a plurality of platform installations, each installation comprising a node, and the system comprising:
 a data ingestion subsystem having a plurality of data receivers, each of the plurality of data receivers adapted to acquire data from specific data sources, the data sources including: WAMS; PMU; DFR; SCADA; and IED; 
 a routing subsystem configured to manage data streams and a message bus subsystem horizontally-scaled for both load balancing and fault-tolerance assurance, the message bus selected from a range of third-party components; 
 a signal identification subsystem, closely interconnected with a data processing subsystem, and configured to form a separate data stream of alarms; and 
 a user interface (UI) backend, configured to provide front-end applications, including information and actionable insights to the end users; wherein the system architecture is scalable and reliable and configured for continuous handling of data streaming from various data sources; 
 the system further including a versatile infrastructure based on:
 a composite message broker; 
 a flexible and adaptable component stack, depending upon a specific implementation task; and 
 the system further configured to ensure: 
 a plug-and-play capability for data, data sources, analysis algorithms, and storage solutions; and 
 a simultaneous handling of numerous data flows, including real-time and historical data. 
 
 
     
     
       2. The system of  claim 1 , wherein the system further comprises:
 a configuration management subsystem having a model data management service, configured to provide respective parameter configuration at start-up to the plurality of data receivers; 
 a data exchange subsystem, configured to access data to ensure node-to-node communication, the data exchange subsystem further configured to obtain settings from the configuration management subsystem; 
 a storage subsystem having a plurality of databases into which all data streams are recorded by means of an access layer; 
 a big data storage subsystem, configured to support streaming data archiving with the system; and 
 a long-term analytics subsystem, which includes third party analytics tools and is configured to provide long-term analytics. 
 
     
     
       3. The system of  claim 2 , wherein the plurality of databases is optimized for types of data, including: model DB for configuration and settings storage; cache for quick read-write operations; and long-term storage for data not accessed in real time, for retrospective analysis. 
     
     
       4. The system of  claim 3 , wherein the routing subsystem is configured to deliver at least raw and processed data streams throughout the platform. 
     
     
       5. A method of using a data acquisition and processing platform system for Industrial Internet of Things (IIoT) analysis and control, the system having a microservice, fault tolerant, and scalable architecture comprising a plurality of platform installations, each installation comprising a node, the method including the steps of:
 a. receiving data from a plurality of data sources including: WAMS; PMU; DFR; SCADA; and IED; and having data streams with different properties; 
 b. forming a communication backbone of the system comprising a routing subsystem, configured to manage data streams and a message bus subsystem horizontally-scaled for both load balancing and fault-tolerance assurance, the message bus selected from a range a third-party components; 
 c. closely interconnected a signal identification subsystem with a data processing subsystem, the signal identification subsystem forming a separate data stream of alarms; and
 providing front-end applications in a user interface (UI) backend including information and actionable insights to the end users; 
 
 
       whereby the system architecture is scalable, reliable, and continuously handles data streaming from various data sources;
 the system further including a versatile infrastructure based on:
 a composite message broker; 
 a flexible and adaptable component stack, depending upon a specific implementation task; and 
 the system further configured to ensure: 
 a plug-and-play capability for data, data sources, analysis algorithms, and storage solutions; and 
 a simultaneous handling of numerous data flows, including real-time and historical data. 
 
 
     
     
       6. The method of  claim 5 , further comprising:
 providing a configuration management subsystem having a model data management service to provide respective parameter configuration at start-up to the plurality of data receivers; 
 accessing data by a data exchange subsystem to ensure node-to-node communication, the data exchange subsystem further obtaining settings from the configuration management subsystem; 
 providing a storage subsystem having a plurality of data bases into which all data streams are recorded by means of an access layer; 
 supporting streaming data archiving with the system with a big data storage subsystem; and 
 providing long-term analytics using a long-term analytics subsystem, which includes third party analytics tools. 
 
     
     
       7. The method of  claim 6 , whereby the plurality of databases is optimized for types of data, including: model DB for configuration and settings storage; cache for quick read-write operations; and long-term storage for data not accessed in real time, for retrospective analysis. 
     
     
       8. The method of  claim 7 , whereby the routing subsystem delivers at least raw and processed data streams throughout the platform.