Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

By default, move all intermediate results to output #92

Closed
yxqd opened this issue Jan 10, 2018 · 0 comments · Fixed by #95
Closed

By default, move all intermediate results to output #92

yxqd opened this issue Jan 10, 2018 · 0 comments · Fixed by #95
Milestone
Version 0.1

Comments

@yxqd
Copy link
Member

yxqd commented Jan 10, 2018 •
edited
Loading

Right now intermediate results are saved in the "fast" working disk. That disk can easily be full.

Remove the "clean_on_the_fly" flag. Add a new parameter "clean_intermediate_files":

  • on_the_fly: clean as they are generated
  • archive: move to output (default)
  • None: keep them

output should be in a slow but much larger disk
@yxqd yxqd changed the title By default, remove all intermediate results By default, move all intermediate results to output Jan 10, 2018
yxqd added a commit that referenced this issue Jan 10, 2018
@yxqd
Refs #92. implemented
e8a46b8
yxqd added a commit that referenced this issue Jan 10, 2018
@yxqd
Refs #92. added workflow tests of "clean_intermediate_files"
85fb4cf
@yxqd yxqd mentioned this issue Jan 10, 2018
Merged
yxqd added a commit that referenced this issue Jan 11, 2018
@yxqd
Refs #92. remove work dir at the end if clean "on the fly". improved …
ac0cba0 
…tests
@yxqd yxqd closed this as completed in #95 Jan 11, 2018
@yxqd yxqd added this to the Version 0.1 milestone Jan 11, 2018
yxqd added a commit that referenced this issue Jan 20, 2018
@yxqd
Refs #75, #92. CT: create a symlink after moving intermediate results…
f9ee4ff 
… from fast disk to output dir
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
Version 0.1
Development

Successfully merging a pull request may close this issue.

options of cleaning intermediate results ornlneutronimaging/iMars3D
1 participant
@yxqd