Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reliable VFolder deletion(purge) #1797

Open
1 task done
Tracked by #767
fregataa opened this issue Dec 19, 2023 · 0 comments
Open
1 task done
Tracked by #767

Reliable VFolder deletion(purge) #1797

fregataa opened this issue Dec 19, 2023 · 0 comments
Assignees
@fregataa
Labels
comp:manager Related to Manager component comp:storage-proxy Related to Storage proxy component type:enhance Enhance component, behavior, internals without user-facing features
Milestone
24.09

Comments

@fregataa
Copy link
Member

fregataa commented Dec 19, 2023 •
edited by achimnol
Loading

Current version: main(before release 24.03.0)

Currently, the vfolder deletion task is run by aiotools.PersistentTaskGroup.
The steps of the task is like below

  1. Update status value of DB vfolders table to PURGE_ONGOING.
  2. Request folder deletion to each storage proxy.
  3. Delete records of DB vfolders table that has been successfully deleted.

The clients do not get informed when any error occurs during this long-term tasks.
There are several ways to resolve this issue.

  • Use BackgroundTask and its server-side response
  • Replace on-time purge request between manager and storage proxy to event using Redis.

Please leave any other idea.

Tasks
Beta Give feedback
  1. feat: improve reliability & usability of VFolder removal API #1884
    area:docs comp:cli comp:client comp:common comp:manager comp:storage-proxy size:L type:enhance urgency:4
    fregataa

Related issues:
@yomybaby yomybaby mentioned this issue Jan 11, 2024
Open
@fregataa fregataa self-assigned this Jan 25, 2024
@fregataa fregataa mentioned this issue Feb 4, 2024
Closed
5 tasks
@achimnol achimnol mentioned this issue Feb 28, 2024
Open
@achimnol achimnol added comp:manager Related to Manager component comp:storage-proxy Related to Storage proxy component type:enhance Enhance component, behavior, internals without user-facing features labels Feb 28, 2024
@achimnol achimnol added this to the 24.03 milestone Feb 28, 2024
@fregataa fregataa modified the milestones: 24.03, 24.09 May 8, 2024
@achimnol achimnol mentioned this issue Jul 8, 2024
Open
15 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fregataa fregataa

Labels
comp:manager Related to Manager component comp:storage-proxy Related to Storage proxy component type:enhance Enhance component, behavior, internals without user-facing features
Projects
None yet
Milestone
24.09
Development

Successfully merging a pull request may close this issue.

feat: improve reliability & usability of VFolder removal API lablup/backend.ai
2 participants
@achimnol @fregataa