Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make download_component concurrent #354

Merged
merged 9 commits into from
Aug 17, 2023
Merged

Make download_component concurrent #354

merged 9 commits into from
Aug 17, 2023

Commits on Aug 17, 2023

  1. Make download_component concurrent

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    582bc1c View commit details
    Browse the repository at this point in the history

  2. Use httpx client in download_images component

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    bdc093d View commit details
    Browse the repository at this point in the history

  3. Turn downloaded image into BytesIO before resizing

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    ce7f7df View commit details
    Browse the repository at this point in the history

  4. Handle empty partitions in download_images component

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    b88375b View commit details
    Browse the repository at this point in the history

  5. Add tests for download_images component

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    e9acbe6 View commit details
    Browse the repository at this point in the history

  6. Re-add user-agent header to download_images

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    f76a7c7 View commit details
    Browse the repository at this point in the history

  7. Revert relative import and modify python path for tests instead

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    949cf5a View commit details
    Browse the repository at this point in the history

  8. Use multiprocessing scheduler for download_images component

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    ef15fa3 View commit details
    Browse the repository at this point in the history

  9. Revert docker tag of download_images component to dev

    @RobbeSneyders
    RobbeSneyders committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    bb7df3e View commit details
    Browse the repository at this point in the history