S3 Integration Testing

To run the integration test, make sure to set up BASE_MOUNT inside config.yml to the correct value, then execute the following command:

poetry run pytest tests/integration/S3_integration_test.py

Additionally, if you want to debug the test (in case it is unexpectedly failing or passing), you can add the flag --log-cli-level 20 to display all the INFO logging done in the code (for more information about the log level, see https://docs.python.org/3/library/logging.html#levels).

To log the test, you can add import logging in the import list, then logger = logging.getLogger(__name__) at the start of the actual test function, then lastly do logger.info("some random string") wherever you need to do logging/debugging (and, of course, replace "some random string" with whatever needs to be logged/debugged).