Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix!: Terminating all VFS processes when cleaning up session #149

Merged
merged 7 commits into from
Feb 21, 2024

Conversation

natmatn
Copy link
Contributor

@natmatn natmatn commented Feb 7, 2024

What was the problem/requirement? (What/Why)

Originally, the best place to terminate deadline VFS processes was in the output sync step. However, with the introduction of step-step dependent jobs, the deadline VFS instances were being terminated between tasks. This caused the jobs to fail as the expected asset roots were no longer mounted when multiple tasks were run in a step.

What was the solution? (How)

Moved the termination call from the deadline-cloud sync_outputs call to the deadline-cloud-worker-agent's session cleanup method.

What is the impact of this change?

Jobs using the "VIRTUAL" asset-loading-method will now support step-step dependencies

How was this change tested?

  • hatch run test
  • Manually confirmed on a CMF instance both step-step and regular jobs are supported

Was this change documented?

No

Is this a breaking change?

yes, needs this commit from deadline-cloud to work
aws-deadline/deadline-cloud@ef782bf

Signed-off-by: Nathan Matthews <natmatn@amazon.com>
Signed-off-by: Nathan Matthews <natmatn@amazon.com>
Signed-off-by: Nathan Matthews <natmatn@amazon.com>
Copy link
Contributor

@marofke marofke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making the changes Nathan, LGTM! 🚢 🦈

mwiebe
mwiebe previously approved these changes Feb 8, 2024
@natmatn natmatn changed the title fix: Terminating all VFS processes when cleaning up session fix!: Terminating all VFS processes when cleaning up session Feb 21, 2024
@natmatn natmatn merged commit 50178ed into mainline Feb 21, 2024
9 checks passed
@natmatn natmatn deleted the natmatn/vfs_cleanup branch February 21, 2024 19:51
gmchale79 pushed a commit that referenced this pull request Mar 11, 2024
* fix!: Terminating all VFS processes when cleaning up session
---------

Signed-off-by: Nathan Matthews <natmatn@amazon.com>
Signed-off-by: Graeme McHale <gmchale@amazon.com>
jusiskin pushed a commit to jusiskin/deadline-cloud-worker-agent that referenced this pull request Sep 4, 2024
Signed-off-by: client-software-ci <129794699+client-software-ci@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants