Stability of the STAC requests #222
Replies: 2 comments 1 reply
-
|
Thanks. A recent update has introduced more of these errors that we're still working through (#217). In the meantime, you might consider adding retries to your requests to the STAC API. stac-utils/pystac-client#520 has some discussion on that, if you're using pystac-client. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the hint - indeed we are using pystac-client for our requests |
Beta Was this translation helpful? Give feedback.
-
|
I've ended up sprinkling |
Beta Was this translation helpful? Give feedback.
-
Hi Planetary Computer folks,
first of all many thanks for putting effort into this super nice platform - I like it quiet a lot and use it for most of my research work as a PhD student.
Together with my colleagues at the Group of Crop Science at ETH Zurich and the EOA-team at Agroscope Reckenholz I have been developing the open-source Python package EOdal, which we also run to fetch Sentinel-2 data from Planetary Computer (see here for an example).
Since we have powerful local hard-ware infrastructure we usually make the queries to STAC from our own machines to fetch the Sentinel-2 data, which is then input into our models required for, e.g., the retrieval of functional crop traits.
While this works fantastically most of the time, in some cases we also get an error message when sending our requests to the STAC endpoint:
This happens seemingly at random (i.e., you can send the same requests 10 times and X times it fails while 10-X time it passes). We query small subsets of data (e.g., a single tile for a single month) as we are aware that there must be some limitations on the server side.
However, it would still be nice if those errors would occur less frequently as it arguably impacts the stability of our programs and requires a lot of error handling.
So I was wondering if there is any possibility to decrease the frequency at which these errors occur? For our applications it would be also fine do work asynchronously, i.e., it does not matter if we have to wait some seconds or not until our request is processed.
I am looking forward to hearing back from you.
Cheers,
Lukas
Beta Was this translation helpful? Give feedback.
All reactions