Design and Implementation of Campus Information Analysis System Based on Spark

Abstract

In order to mine the data of "campus card" system, a campus information analysis system based on Spark is designed. The front end of the system is developed using the Django framework. The front end of the system is developed using the Django framework, and the data processing uses the Spark distributed framework, and the results of the analysis by way of chart visual feedback to the user, so as to realize data preprocessing, data analysis, data presentation and other functions.