Spark Streaming

Overview

In this tutorial, I'm showing spark streaming from txt file that reads spark dynamically

Requirements

Configure Apache Spark
install pyspark (Python Library) using pip install pyspark

Execution

Check video from youtube https://www.youtube.com/watch?v=bm28UYrYOeE

Firstly Run spark streaming in ternimal using below command

spark-submit streaming.py

#This command will start spark streaming

Now execute file.py using python that will create log text file in folder and spark will read as streaming
```
python file.py
```

Output