Skip to content

Trying to build a multi stage data pipeline with pythons multi processing

Notifications You must be signed in to change notification settings

vyz1194/synctatic_task

Repository files navigation

synctatic_task

Trying to build a multi stage data pipeline with pythons multi processing

##DONE :##

established a multi stage pipeline connected via multiprocesssing pipes

###TODO :###

Error Handling, File Checks, Try to convert this into near realtime execution, where the code keeps running and checks and waits for the files to arrive

About

Trying to build a multi stage data pipeline with pythons multi processing

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages