Data Query and Mining Frameworks for Storm

Abstract

Storm is an open source fault-tolerant and real-time computation system. Storm makes it easy to process unbounded streams of data reliably. In this paper, we first discuss different application scenarios and main features of Storm in details. Then, we analyze the framework design of streaming data query and the framework design of data mining based on Storm. The algorithm optimization of data stream mining is introduced as well. Finally, we propose a new data stream query framework based on a vertical parallel algorithm which can improve the performance of data mining.