Skip to content

slcnyagmurnew/airflow-kafka-json

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

airflow-kafka-json

This study is working with data/counts.json file.

Data is divided into small one data json files and saved into Postgre DB. They are sent to Kafka broker from Postgre with given interval to read as stream data.

Read data is gone to data/garbage directory. Data is updated in both Kafka and Postgre DB.

Up the Docker containers with run:

docker-compose up -d

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published