Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add cuda-nvcc, update base image, and update locks #52

Merged
merged 5 commits into from
Oct 5, 2022

Conversation

ngam
Copy link
Contributor

@ngam ngam commented Sep 30, 2022

xref pangeo-data/pangeo-docker-images#378 for ease, but mainly:

adding cuda-nvcc to get ptxas to be readily available in the environment (xla relies on ptxas to work correctly). Note missing ptxas would not have necessarily resulted in any errors in tf/jax, but without ptxas (cuda-nvcc), xla simply doesn't work, so it would go back to unoptimized performance.

ptxas isn't available in conda-forge at the moment. It is available in some images (i.e. any image built on top of NVIDIA's NGC images) and it is available on their conda channel (nvidia). I am told it is a licensing issue, but I don't really know. There will likely be a move to bundle it inside jax going forward, but that's beyond me.

@TomAugspurger this is ready for review. Thank you!

@TomAugspurger
Copy link

Thanks. Will take a look this week.

@TomAugspurger TomAugspurger merged commit 7128d9f into microsoft:main Oct 5, 2022
@TomAugspurger
Copy link

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants