Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nextflow clean: Can't perform I/O on pseudo-directories #5647

Open
nick-youngblut opened this issue Jan 6, 2025 · 2 comments
Open

nextflow clean: Can't perform I/O on pseudo-directories #5647

nick-youngblut opened this issue Jan 6, 2025 · 2 comments

Comments

@nick-youngblut
Copy link
Contributor

Bug report

nextflow clean $RUN_NAME -force -quiet

Error:

ERROR ~ Can't perform I/O on pseudo-directories (trailing slash): /BUCKET_NAME/RUN_NAME/24/0b221c571de08d4b5dcb7f9fcca4e1

Notes:

  • I'm running nextflow clean directory after running nextflow run with the same run name.
  • I'm running the nextflow clean on a GCP Cloud Run job

The working directory in the GCP bucket is not "cleaned".

Expected behavior and actual behavior

See above

Steps to reproduce the problem

See above

Program output

See above

Environment

  • Nextflow version: 24.10.2
  • Java version: 21.0.0
  • Operating system: Linux
  • Bash version: 5.1.16
@ynsoysa
Copy link

ynsoysa commented Jan 26, 2025

I have seen the exact same error after cleaning up few work directories on GCP using Nextflow version: 24.10.1 , was there any resolution?

Thank you

@bentsherman
Copy link
Member

Can you try with 24.04? I'm wondering if it's a regression.

If not that, it may be that "directories" in GCS don't need to be deleted because they are just prefixes:

private static delete0(Path path, boolean dir) {
try {
log.trace "Deleting path [dir=$dir]: ${path.toUriString()}"
Files.delete(path)
return true
}
catch( IOException e ) {
// kind of hack: directory deletion
if( dir && path.scheme=='gs' && e instanceof NoSuchFileException )
return true
log.debug("Failed to remove path: ${path.toUriString()}", e)
return false
}
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants