Python based queued file downloader.
The workflow for WebGet goes like this:
- Send POST request with link to WebGet
- WebGet adds link to SQLite DB
- Threaded downloader checks queue for new link
- When link is found, downloader starts downloading file
- When download is complete, downloader checks back with SQLite queue for more files
The amount of concurrent downloads is currently set at 2, but it can easily be changed to allow more concurrent downloads.