Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move backup/restore logic to the Charm #80

Open
kimwnasptd opened this issue May 2, 2024 · 1 comment
Open

Move backup/restore logic to the Charm #80

kimwnasptd opened this issue May 2, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@kimwnasptd
Copy link
Contributor

kimwnasptd commented May 2, 2024

Context

Right now the backup and restore guide is telling users to run the following commands to create a dump of the sqlite content of MLMD's PVC:

# CKF 1.8
MLMF_POD="mlmd-0"
MLMD_CONTAINER="mlmd"

kubectl exec -n kubeflow $MLMD_POD -c $MLMD_CONTAINER -- \
    /bin/bash -c "apt update && apt install sqlite3 -y"

This has the following 2 drawbacks:

  1. It will not work in airgap environments
  2. Users need to manually use commands to create the backup and push it to S3

What needs to get done

  1. Include any binaries needed for the backup into the Charm (could be separate task)
  2. Have an action that can make the backup and push it to S3
    1. Will most probably need to have a relation with s3-interface for this

This will also need to take into account if MLMD should block receiving traffic when making the backup or not (scaling down the pebble service).

Definition of Done

  1. Have a spike to confirm we know if MLMD should be up/down when doing the backup
  2. The action can be executed in an airgapped environment
  3. Users don't need to run any manual commands from their machine
  4. The data will go directly from the Charm to S3
@kimwnasptd kimwnasptd added the enhancement New feature or request label May 2, 2024
Copy link

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-5624.

This message was autogenerated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant