An IoT System Design with Real-Time Stream Processing and Data Flow Integration

Abstract

This work presents an Internet of Thing (IoT) system design method with real-time processing that integrates various tools together as a model for further development or implementation of IoT system for various applications. The system has a data flow design on Apache NiFi for data stream processing that works with Apache Kafka for stream distribution, and data are stored in MongoDB. It also has data processing with Apache Storm that can process data quickly and display data on the Dashboard via Node-RED. In addition to the basic data storage system, there is also an additional function that can retrieve the stored data on database for further use by using REST API working on Node.js by Swagger standard. This foundation system is designed to be a prototype for those who want to design and use the platform with real-time processing characteristics. After testing, the designed system shows good working performance. It can display all values on the Dashboard completely in real-time and have a fast operation. The tools used in the study can be further developed for a more complex and larger system.