That repo helps to you effiecient making scraper.

Using by;

Fastapi > backend

Celery > scheduled and asyncrhonus tasks

Redis > message queue for Celery

Cassandra > database

Docker > Containerize

Disclaimer: If you schedule the celery in very frequent time slots. The internet provider will be ban to you.

I'm thinking of adding docstrings I'll try to keep the repo up to date. You can specify your suggestions by opening an issue.