Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Testing fails on unsupported devices. #1815

Closed
stmorgenstern opened this issue Mar 20, 2023 · 0 comments · Fixed by #1818
Closed

Testing fails on unsupported devices. #1815

stmorgenstern opened this issue Mar 20, 2023 · 0 comments · Fixed by #1818
Labels
tests Adds or changes tests.

Comments

@stmorgenstern
Copy link

Describe the bug

A clear and concise description of what the bug is.
Able to perform operations with CUDA itself, but failing to test the package using Pkg.test("CUDA"). Attempts to test produce the following bug

ERROR: LoadError: Could not find any suitable device for this configuration

To reproduce

The Minimal Working Example (MWE) for this bug:

# some code here
using Pkg
Pkg.test("CUDA")
Manifest.toml 

Paste your Manifest.toml here, or accurately describe which version of CUDA.jl and its dependencies (GPUArrays.jl, GPUCompiler.jl, LLVM.jl) you are using.

Full stacktrace during test:
[79e6a3ab] Adapt v3.6.1
  [ab4f0b2a] BFloat16s v0.4.2
  [052768ef] CUDA v4.0.1 `https://github.com/JuliaGPU/CUDA.jl.git#master`
  [864edb3b] DataStructures v0.18.13
  [7a1cc6ca] FFTW v1.6.0
  [0c68f7d7] GPUArrays v8.6.4
  [a98d9a8b] Interpolations v0.14.7
  [872c559c] NNlib v0.8.19
  [276daf66] SpecialFunctions v2.2.0
  [a759f4b9] TimerOutputs v0.5.22
  [76a88914] CUDA_Runtime_jll v0.4.0+0
  [ade2ca70] Dates `@stdlib/Dates`
  [8ba89e20] Distributed `@stdlib/Distributed`
  [37e2e46d] LinearAlgebra `@stdlib/LinearAlgebra`
  [de0858da] Printf `@stdlib/Printf`
  [3fa0cd96] REPL `@stdlib/REPL`
  [9a3f8284] Random `@stdlib/Random`
  [2f01184e] SparseArrays `@stdlib/SparseArrays`
  [10745b16] Statistics `@stdlib/Statistics`
  [8dfed614] Test `@stdlib/Test`
      Status `C:\Users\Sam\AppData\Local\Temp\jl_He8QSg\Manifest.toml`
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Preferences\pWSk8_zLrKK.ji for Preferences [21216c6a-2e73-6563-6e65-726566657250]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\JLLWrappers\7Zgw7_zLrKK.ji for JLLWrappers [692b3bcd-3c85-4b1f-b108-f13ce0eb3210]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CUDA_Driver_jll\QJyk7_zLrKK.ji for CUDA_Driver_jll [4ee394cb-3365-5eb0-8335-949819d2adfc]
└ @ Base loading.jl:806
┌ Debug: CUDA version override: 12.1
└ @ Main C:\Users\Sam\.julia\packages\CUDA_Runtime_jll\cq9MZ\.pkg\platform_augmentation.jl:28
┌ Debug: Selected CUDA toolkit: 12.1.0
└ @ Main C:\Users\Sam\.julia\packages\CUDA_Runtime_jll\cq9MZ\.pkg\platform_augmentation.jl:131
  [621f4979] AbstractFFTs v1.3.1
  [79e6a3ab] Adapt v3.6.1
  [13072b0f] AxisAlgorithms v1.0.1
  [ab4f0b2a] BFloat16s v0.4.2
  [fa961155] CEnum v0.4.2
  [052768ef] CUDA v4.0.1 `https://github.com/JuliaGPU/CUDA.jl.git#master`
  [1af6417a] CUDA_Runtime_Discovery v0.1.1
  [d360d2e6] ChainRulesCore v1.15.7
  [9e997f8a] ChangesOfVariables v0.1.6
  [34da2185] Compat v4.6.1
  [864edb3b] DataStructures v0.18.13
  [ffbed154] DocStringExtensions v0.9.3
  [e2ba6199] ExprTools v0.1.9
  [7a1cc6ca] FFTW v1.6.0
  [0c68f7d7] GPUArrays v8.6.4
  [46192b85] GPUArraysCore v0.1.4
  [61eb1bfa] GPUCompiler v0.18.0
  [a98d9a8b] Interpolations v0.14.7
  [3587e190] InverseFunctions v0.1.8
  [92d709cd] IrrationalConstants v0.2.2
  [692b3bcd] JLLWrappers v1.4.1
  [929cbde3] LLVM v4.16.0
  [2ab3a3ac] LogExpFunctions v0.3.23
  [872c559c] NNlib v0.8.19
  [6fe1bfb0] OffsetArrays v1.12.9
  [bac558e1] OrderedCollections v1.4.1
  [21216c6a] Preferences v1.3.0
  [74087812] Random123 v1.6.0
  [e6cf234a] RandomNumbers v1.5.3
  [c84ed2f1] Ratios v0.4.3
  [189a3867] Reexport v1.2.2
  [ae029012] Requires v1.3.0
  [276daf66] SpecialFunctions v2.2.0
  [90137ffa] StaticArrays v1.5.17
  [1e83bf80] StaticArraysCore v1.4.0
  [a759f4b9] TimerOutputs v0.5.22
  [efce3f68] WoodburyMatrices v0.5.5
  [4ee394cb] CUDA_Driver_jll v0.4.0+0
  [76a88914] CUDA_Runtime_jll v0.4.0+0
  [f5851436] FFTW_jll v3.3.10+0
  [1d5cc7b8] IntelOpenMP_jll v2018.0.3+2
⌅ [dad2f222] LLVMExtra_jll v0.0.16+2
  [856f044c] MKL_jll v2022.2.0+0
  [efe28fd5] OpenSpecFun_jll v0.5.5+0
  [0dad84c5] ArgTools v1.1.1 `@stdlib/ArgTools`
  [56f22d72] Artifacts `@stdlib/Artifacts`
  [2a0f44e3] Base64 `@stdlib/Base64`
  [ade2ca70] Dates `@stdlib/Dates`
  [8ba89e20] Distributed `@stdlib/Distributed`
  [f43a241f] Downloads v1.6.0 `@stdlib/Downloads`
  [7b1f6079] FileWatching `@stdlib/FileWatching`
  [b77e0a4c] InteractiveUtils `@stdlib/InteractiveUtils`
  [4af54fe1] LazyArtifacts `@stdlib/LazyArtifacts`
  [b27032c2] LibCURL v0.6.3 `@stdlib/LibCURL`
  [76f85450] LibGit2 `@stdlib/LibGit2`
  [8f399da3] Libdl `@stdlib/Libdl`
  [37e2e46d] LinearAlgebra `@stdlib/LinearAlgebra`
  [56ddb016] Logging `@stdlib/Logging`
  [d6f4376e] Markdown `@stdlib/Markdown`
  [a63ad114] Mmap `@stdlib/Mmap`
  [ca575930] NetworkOptions v1.2.0 `@stdlib/NetworkOptions`
  [44cfe95a] Pkg v1.8.0 `@stdlib/Pkg`
  [de0858da] Printf `@stdlib/Printf`
  [3fa0cd96] REPL `@stdlib/REPL`
  [9a3f8284] Random `@stdlib/Random`
  [ea8e919c] SHA v0.7.0 `@stdlib/SHA`
  [9e88b42a] Serialization `@stdlib/Serialization`
  [1a1011a3] SharedArrays `@stdlib/SharedArrays`
  [6462fe0b] Sockets `@stdlib/Sockets`
  [2f01184e] SparseArrays `@stdlib/SparseArrays`
  [10745b16] Statistics `@stdlib/Statistics`
  [fa267f1f] TOML v1.0.0 `@stdlib/TOML`
  [a4e569a6] Tar v1.10.1 `@stdlib/Tar`
  [8dfed614] Test `@stdlib/Test`
  [cf7118a7] UUIDs `@stdlib/UUIDs`
  [4ec0a83e] Unicode `@stdlib/Unicode`
  [e66e0078] CompilerSupportLibraries_jll v1.0.1+0 `@stdlib/CompilerSupportLibraries_jll`
  [deac9b47] LibCURL_jll v7.84.0+0 `@stdlib/LibCURL_jll`
  [29816b5a] LibSSH2_jll v1.10.2+0 `@stdlib/LibSSH2_jll`
  [c8ffd9c3] MbedTLS_jll v2.28.0+0 `@stdlib/MbedTLS_jll`
  [14a3606d] MozillaCACerts_jll v2022.2.1 `@stdlib/MozillaCACerts_jll`
  [4536629a] OpenBLAS_jll v0.3.20+0 `@stdlib/OpenBLAS_jll`
  [05823500] OpenLibm_jll v0.8.1+0 `@stdlib/OpenLibm_jll`
  [83775a58] Zlib_jll v1.2.12+3 `@stdlib/Zlib_jll`
  [8e850b90] libblastrampoline_jll v5.1.1+0 `@stdlib/libblastrampoline_jll`
  [8e850ede] nghttp2_jll v1.48.0+0 `@stdlib/nghttp2_jll`
  [3f19e933] p7zip_jll v17.4.0+0 `@stdlib/p7zip_jll`
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading.
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Preferences\pWSk8_zLrKK.ji for Preferences [21216c6a-2e73-6563-6e65-726566657250]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\JLLWrappers\7Zgw7_zLrKK.ji for JLLWrappers [692b3bcd-3c85-4b1f-b108-f13ce0eb3210]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CUDA_Driver_jll\QJyk7_zLrKK.ji for CUDA_Driver_jll [4ee394cb-3365-5eb0-8335-949819d2adfc]
└ @ Base loading.jl:806
┌ Debug: CUDA version override: 12.1
└ @ Main C:\Users\Sam\.julia\packages\CUDA_Runtime_jll\cq9MZ\.pkg\platform_augmentation.jl:28
┌ Debug: Selected CUDA toolkit: 12.1.0
└ @ Main C:\Users\Sam\.julia\packages\CUDA_Runtime_jll\cq9MZ\.pkg\platform_augmentation.jl:131
     Testing Running tests...
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\ExprTools\eM8wu_zLrKK.ji for ExprTools [e2ba6199-217a-4e67-a87a-7c52f15ade04]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\TimerOutputs\hd2yD_zLrKK.ji for TimerOutputs [a759f4b9-e2f1-59dc-863e-4aeb61b1ea8f]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CEnum\0gyUJ_zLrKK.ji for CEnum [fa961155-64e5-5f13-b03f-caf6b980ea82]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Preferences\pWSk8_zLrKK.ji for Preferences [21216c6a-2e73-6563-6e65-726566657250]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\JLLWrappers\7Zgw7_zLrKK.ji for JLLWrappers [692b3bcd-3c85-4b1f-b108-f13ce0eb3210]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\LLVMExtra_jll\R9OeX_zLrKK.ji for LLVMExtra_jll [dad2f222-ce93-54a1-a47d-0025e8a3acab]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\LLVM\e8NBy_zLrKK.ji for LLVM [929cbde3-209d-540e-8aea-75f648917ca0]
└ @ Base loading.jl:806
┌ Debug: Using LLVM 13.0.1 at C:\Users\Sam\AppData\Local\Programs\Julia-1.8.5\bin\libLLVM-13jl.dll
└ @ LLVM C:\Users\Sam\.julia\packages\LLVM\s3bxG\src\LLVM.jl:86
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\GPUCompiler\yPwef_zLrKK.ji for GPUCompiler [61eb1bfa-7361-4325-ad38-22787b887f55]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Requires\IyxeS_zLrKK.ji for Requires [ae029012-a4dd-5104-9daa-d747884805df]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Adapt\rUIgN_zLrKK.ji for Adapt [79e6a3ab-5dfb-504d-930d-738a2a938a0e]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Reexport\bTpYr_zLrKK.ji for Reexport [189a3867-3050-52da-a836-e630ba90ab69]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\GPUArraysCore\qiYUe_zLrKK.ji for GPUArraysCore [46192b85-c4d5-4398-a991-12ede77f4527]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\GPUArrays\v5u0T_zLrKK.ji for GPUArrays [0c68f7d7-f131-5f86-a1c3-88cf8149b2d7]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\BFloat16s\iiZ8G_zLrKK.ji for BFloat16s [ab4f0b2a-ad5b-11e8-123f-65d77653426b]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CUDA_Driver_jll\QJyk7_zLrKK.ji for CUDA_Driver_jll [4ee394cb-3365-5eb0-8335-949819d2adfc]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CUDA_Runtime_jll\Hs50y_AO5oN.ji for CUDA_Runtime_jll [76a88914-d11a-5bdc-97e0-2f5a05c973a2]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\RandomNumbers\pgCpR_zLrKK.ji for RandomNumbers [e6cf234a-135c-5ec9-84dd-332b85af5143]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Random123\1imiM_zLrKK.ji for Random123 [74087812-796a-5b5d-8853-05524746bad3]
└ @ Base loading.jl:806
┌ Debug: Requires conditionally ran code in 0.162124 seconds: `RandomNumbers` detected `Random123`
└ @ Requires C:\Users\Sam\.julia\packages\RandomNumbers\3pD1N\src\RandomNumbers.jl:38
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\Compat\GSFWK_zLrKK.ji for Compat [34da2185-b29b-5c13-b0c7-acf172513d20]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\ChainRulesCore\G6ax7_zLrKK.ji for ChainRulesCore [d360d2e6-b24c-11e9-a2a3-2a2ae2dbcce4]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\AbstractFFTs\Di3HZ_zLrKK.ji for AbstractFFTs [621f4979-c628-5d54-868e-fcf4e3e8185c]
└ @ Base loading.jl:806
┌ Debug: Loading cache file C:\Users\Sam\.julia\compiled\v1.8\CUDA\oWw5k_zLrKK.ji for CUDA [052768ef-5323-5732-b1bb-66c8b64840ba]
└ @ Base loading.jl:806
┌ Info: System information:
│ CUDA runtime 12.1, artifact installation
│ CUDA driver 12.1
│ NVIDIA driver 531.29.0
│
│ Libraries:
│ - CUBLAS: 12.1.0
│ - CURAND: 10.3.2
│ - CUFFT: 11.0.2
│ - CUSOLVER: 11.4.4
│ - CUSPARSE: 12.0.2
│ - CUPTI: 18.0.0
│ - NVML: 12.0.0+531.29
│
│ Toolchain:
│ - Julia: 1.8.5
│ - LLVM: 13.0.1
│ - PTX ISA support: 3.2, 4.0, 4.1, 4.2, 4.3, 5.0, 6.0, 6.1, 6.3, 6.4, 6.5, 7.0, 7.1, 7.2
│ - Device capability support: sm_37, sm_50, sm_52, sm_53, sm_60, sm_61, sm_62, sm_70, sm_72, sm_75, sm_80, sm_86
│
│ 1 device:
└   0: NVIDIA GeForce RTX 4070 Ti (sm_89, 9.852 GiB / 11.994 GiB available)

Expected behavior

A clear and concise description of what you expected to happen.
The package tests should run

Version info

Details on Julia:

# please post the output of:
versioninfo()

Julia Version 1.8.5
Commit 17cfb8e65e (2023-01-08 06:45 UTC)
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 32 × AMD Ryzen 9 7950X 16-Core Processor
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-13.0.1 (ORCJIT, znver3)
  Threads: 32 on 32 virtual cores

Details on CUDA:

# please post the output of:
CUDA.versioninfo()
CUDA runtime 12.1, artifact installation
CUDA driver 12.1
NVIDIA driver 531.29.0

Libraries:
- CUBLAS: 12.1.0
- CURAND: 10.3.2
- CUFFT: 11.0.2
- CUSOLVER: 11.4.4
- CUSPARSE: 12.0.2
- CUPTI: 18.0.0
- NVML: 12.0.0+531.29

Toolchain:
- Julia: 1.8.5
- LLVM: 13.0.1
- PTX ISA support: 3.2, 4.0, 4.1, 4.2, 4.3, 5.0, 6.0, 6.1, 6.3, 6.4, 6.5, 7.0, 7.1, 7.2
- Device capability support: sm_37, sm_50, sm_52, sm_53, sm_60, sm_61, sm_62, sm_70, sm_72, sm_75, sm_80, sm_86

1 device:
  0: NVIDIA GeForce RTX 4070 Ti (sm_89, 10.323 GiB / 11.994 GiB available)

Additional context

Add any other context about the problem here.

Just set everything up on a new machine running an RTX 4070 TI and Windows 11
@stmorgenstern stmorgenstern added the bug Something isn't working label Mar 20, 2023
@maleadt maleadt mentioned this issue Mar 21, 2023
Merged
@maleadt maleadt added tests Adds or changes tests. and removed bug Something isn't working labels Mar 21, 2023
@maleadt maleadt changed the title Pkg.test("CUDA") causes LoadError: Could not find any suitable device for this configuration despite normal package functionality Testing fails on unsupported devices. Mar 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
tests Adds or changes tests.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Allow but warn when testing on not fully-supported devices. JuliaGPU/CUDA.jl
2 participants
@maleadt @stmorgenstern