Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Factorize client interface and provide "download all in range" #64

Open
wants to merge 25 commits into
base: master
Choose a base branch
from
Open

Factorize client interface and provide "download all in range" #64

wants to merge 25 commits into from
+115,010 −111,633

Commits on Sep 6, 2024

  1. WIP: factorize client interface

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    cc425ff View commit details
    Browse the repository at this point in the history

  2. Use $NETRC (before ~/.netrc) if no file is given

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    a6c6f1f View commit details
    Browse the repository at this point in the history

  3. Add typing notations

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    bca24fe View commit details
    Browse the repository at this point in the history

  4. Authenticate only to download 

    There is no need to authenticate is order to search for available products
    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    1c2667a View commit details
    Browse the repository at this point in the history

  5. Add API to request all orbits within a time range 

    So far, `query_orbit` and `query_orbit_by_dt` (on Dataspace side) return only
one orbit file: the one that contains the requested time range.

The new `query_orbits_by_dt_range` method returns all orbit file contained in
the requested time range.

In order to factorize code, internal `_QueryOrbitFile` classes are defined.
    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    0f77cf5 View commit details
    Browse the repository at this point in the history

  6. Update ASF test

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    28cd506 View commit details
    Browse the repository at this point in the history

  7. Fix typing notations & some pylint warnings

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    b94de9a View commit details
    Browse the repository at this point in the history

  8. Separate search from authenticated download w/ ASF

    Luc Hermitte committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    4023d85 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Improve/fix typing

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    f907cf4 View commit details
    Browse the repository at this point in the history

  2. Implement query all eofs that intersect time range

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    350b014 View commit details
    Browse the repository at this point in the history

  3. Check listing of EOF files on ASF once only 

    EOF files on ASF server are listed once only in tests. Ideally this should have
been mocked, but interrogation is still kept.

Other tests will rely on a snapshot of precise orbit files that is cached.
A test dedicated to testing the use of the cached baseline has been defined.
    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ec08c70 View commit details
    Browse the repository at this point in the history

  4. Make the EOF cache local to easu ASF client 

    ...instead of global and shared among all ASFClient instances.
    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d4b9804 View commit details
    Browse the repository at this point in the history

  5. Test ASF-query of all EOFs intersecting time range

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d3551ad View commit details
    Browse the repository at this point in the history

  6. Address some of pylint/mypy remarks

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    56c2088 View commit details
    Browse the repository at this point in the history

  7. Declare dependency to sortedcontainers

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    7f042ce View commit details
    Browse the repository at this point in the history

  8. Declare dependency to sortedcontainers (2)

    Luc Hermitte committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c014cb4 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Update cassettes without secrets

    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    699cfbf View commit details
    Browse the repository at this point in the history

  2. Remove secrets from cassettes

    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    2d3c2c7 View commit details
    Browse the repository at this point in the history

  3. Update secret curated cassettes

    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    738b883 View commit details
    Browse the repository at this point in the history

  4. Prevent cassettes from recording secrets 

    And factorize out the creation of CDSE Access Token in order to to be able to
inject 2FA token from the command line.
In the end, no token nor secrets are recorded.
    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    4bf239c View commit details
    Browse the repository at this point in the history

  5. Use pre-recorded baseline for search ASF EOF files 

    This will concern tests in test_eof.py. DB searching is tested in
test_asf_client.py
    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    962e539 View commit details
    Browse the repository at this point in the history

  6. Use pre-recorded baseline for search ASF EOF files

    Luc Hermitte committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ea7da1e View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Use logger for debug logs

    Luc Hermitte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    892179e View commit details
    Browse the repository at this point in the history

  2. Remove dependency to sortedcontainers

    Luc Hermitte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    192e627 View commit details
    Browse the repository at this point in the history

  3. Don't apply offsets when searching range w/ ASF

    Luc Hermitte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8b4c5f4 View commit details
    Browse the repository at this point in the history