split up CUDA-suffixed dependencies in dependencies.yaml

[jameslamb]

Description

Contributes to rapidsai/build-planning#31

Follow-up to #15245

RAPIDS DLFW builds prefer to build all RAPIDS packages together without CUDA suffixes, leading to the following set of requirements for cudf wheels built there:

• project name must be cudf (not cudf-cu12)
• all dependencies must be unsuffixed (e.g. rmm not rmm-cu12)
• the correct set of dependencies based on CUDA version must be expressed in the wheel metadata (e.g. cubinlinker and ptxcompiler on CUDA 11, pynvjitlink on CUDA 12)

To meet all 3 of those, this proposes decomposing CUDA-suffixed dependencies in dependencies.yaml into two lists... cuda_suffixed="true" and cuda_suffixed="false".

That'd allow DLFW builds to do the following to meet its requirements:

pip wheel \
  -C rapidsai.disable-cuda=true \
  -C rapidsai.matrix-entry="cuda=12.5;cuda_suffixed=false" \
  .

Checklist

• I am familiar with the Contributing Guidelines.
• New or existing tests cover these changes.
• The documentation is up to date with these changes.

Notes for Reviewers

Why still have the fallback matrices be CUDA 11 dependencies?

I'd originally included changese for rapidsai/build-planning#68 here, but chose to revert them to reduce the size of this diff and to make it absolutely clear... the fallback matrices' values are not relevant for devcontainers, DLFW, or normal wheel builds.

[vyasr]

@jameslamb this PR says it's a follow up to #15425, but that looks unrelated. Did you mean something else?

What is the plan for this PR?

[jameslamb]

Blegh yes that should have been #15245 (you can see how those got switched haha).

What is the plan for this PR?

I'd still like to get it into 24.08 if possible. I'm experimenting with different ways to do this, and hoping to avoid having to make similar changes across all the RAPIDS repos... but haven't quite found a working mix of changes yet. Will @ you when I have something that's ready for review.

[jameslamb]

I believe this error in the pip devcontainer:

  ERROR: Ignored the following versions that require a different python version: 0.52.0 Requires-Python >=3.6,<3.9; 0.52.0rc3 Requires-Python >=3.6,<3.9; 0.53.0 Requires-Python >=3.6,<3.10; 0.53.0rc1.post1 Requires-Python >=3.6,<3.10; 0.53.0rc2 Requires-Python >=3.6,<3.10; 0.53.0rc3 Requires-Python >=3.6,<3.10; 0.53.1 Requires-Python >=3.6,<3.10; 0.54.0 Requires-Python >=3.7,<3.10; 0.54.0rc2 Requires-Python >=3.7,<3.10; 0.54.0rc3 Requires-Python >=3.7,<3.10; 0.54.1 Requires-Python >=3.7,<3.10
  ERROR: Could not find a version that satisfies the requirement rmm==24.8.*,>=0.0.0a0 (from versions: 0.0.1)
  
  ERROR: No matching distribution found for rmm==24.8.*,>=0.0.0a0

(build link)

Would be fixed by rapidsai/devcontainers#365

[jameslamb]

Please manually verify that ci/release/update-version.sh works as intended. You can run ci/release/update-version.sh 24.10.00 and make sure there are no lingering 24.08 references.

Good suggestion, thank you. That did reveal a few places missed by update-version.sh (though none related to this PR). I pushed the fixes here.

./ci/update-version.sh '24.10.00'
git grep -E '24\.8|24\.08'

As you merge these PRs, please help take care of those manual forward merges as well.

Will do.

[vyasr]

/merge