RedditCheck Crawl Reddit every 1 minute .
2023-06-22.16-34-42.mp4
- Take screenshots of Reddit post
- Crawl
- Comments
- User id
- Username
- post url
- post id
- upvote
- Live Dashboard
- Every 3 seconds all data updating in dashboard screen
- Total Data size , Screenshot count , Following subreddits , Last crawled posts
- Multithread
- Automatically scale thread count
- Detetcs no new post and interrupt
- Several optimizations for slenium browser due to huge resource usage
python manage.py runserver
- http://127.0.0.1:8000/admin
- After the runserver command login admin panel and then add your subreddits . 1 minute later crawling will be start . Default user credential admin:admin . The database and default user were left intentionally.
sudo docker build -t reddit-check .
sudo docker run -p 8000:8000 reddit-check