Real Time Processing System of Massive Data Stream in Internet of Things Based on Apache Storm

Abstract

The data of Internet of Things has the characteristics of real time and large scale. For the data, real-time processing is usually necessary, especially in some security scenarios, this paper tries to design a system which can support the real-time processing of large data flow. This paper firstly analyzes the characteristics of the data flow in the Internet of Things, and by using the results of the analysis, I puts forward the key technologies that can be used in the system and the main problems faced. Finally, I describe the architecture of the system I designed in detail from three aspects of data access, data processing and data storage.