- 🎯 We aim in this academic project to create a data streaming pipeline using
Spark Streaming
,ElasticSearch
andKibana
. - 👍 The workflow consists of generating continuous log data in a log file. then process it using spark streaming, the output is stored with Elastic Search and visualized in a Dashboard using Kibana.
- 💥 Here is a small tutorial to run the project on your own machine :
- 🙌 Project tutorial
- 🤝 This work has been done by : Snoussi Amine, Jawhar Mohammed , Isbaine mohamed and Me.
- 📫 Feel free to contact me (labrijisaad@gmail.com), or the collaborators if anything is wrong or if anything needs to be changed 😎!