Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{2023.06}[foss/2023a] PyTorch-bundle 2.1.2 with CUDA/12.1.1 #387

Open
wants to merge 18 commits into
base: nessi.no-2023.06
Choose a base branch
from
Open

{2023.06}[foss/2023a] PyTorch-bundle 2.1.2 with CUDA/12.1.1 #387

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
a55c6c9
missing changes provided in EESSI PR 579
truib May 30, 2024
ee8b22d
script to copy rather than link GPU driver libraries; needed when sym…
truib May 30, 2024
43f5101
tooling and data to replace ctypes/util.py in Python/3.11.3
truib May 30, 2024
cd474d8
{2023.06}[foss/2023a] Python-bundle v2.1.2 with CUDA/12.1.1
truib May 30, 2024
1cfcd06
tweak lower_dirs code and use from-pr
truib May 30, 2024
6e45922
fix syntax + more debug output
truib May 30, 2024
7f61771
change logic for adding lower dirs
truib May 30, 2024
bfdf0ab
rename replace file to deactivate replacement
truib May 31, 2024
f95918f
add changes from librosa PR
truib Jun 4, 2024
ebf5508
add cuda compute capabilities
truib Jun 5, 2024
8c1daf1
minor updates
truib Jun 5, 2024
a92de97
update method and location to install custom_ctypes
truib Jun 5, 2024
11d6992
add parse_hook for SentencePiece on aarch64/generic
truib Jun 7, 2024
18f3672
don't raise Error on non-aarch64/generic
truib Jun 7, 2024
30d22b4
update with nessi/nessi.no-2023.06
truib Jun 9, 2024
77fd374
add PyTorch-bundle with CUDA
truib Jun 9, 2024
63d97ce
Merge branch 'nessi.no-2023.06' of github-trz:NorESSI/software-layer …
truib Jun 9, 2024
6752be3
use tmp for host-injections
truib Jun 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions bot/build.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -276,9 +276,12 @@ fi
# Retain location for host injections so we don't reinstall CUDA
# (Always need to run the driver installation as available driver may change)

if [[ ! -z ${SHARED_FS_PATH} ]]; then
BUILD_STEP_ARGS+=("--host-injections" "${SHARED_FS_PATH}/host-injections")
fi
# use $STORAGE for host-injections (maybe shared fs is not behaving well)
mkdir -p ${STORAGE}/host_injections
BUILD_STEP_ARGS+=("--host-injections" "${STORAGE}/host-injections")
#if [[ ! -z ${SHARED_FS_PATH} ]]; then
# BUILD_STEP_ARGS+=("--host-injections" "${SHARED_FS_PATH}/host-injections")
#fi

# create tmp file for output of build step
build_outerr=$(mktemp build.outerr.XXXX)
Expand Down
5 changes: 5 additions & 0 deletions easystacks/pilot.nessi.no/2023.06/eessi-2023.06-eb-4.9.1-2023a.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,3 +75,8 @@ easyconfigs:
from-pr: 19987
- tensorboard-2.15.1-gfbf-2023a.eb
- tqdm-4.66.1-GCCcore-12.3.0.eb
- PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb:
# see https://github.com/easybuilders/easybuild-easyconfigs/pull/20484
options:
from-pr: 20484
cuda-compute-capabilities: 6.0,6.1,7.0,7.5,8.0,8.6,8.9,9.0
2 changes: 1 addition & 1 deletion eb_hooks.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@

import easybuild.tools.environment as env
from easybuild.easyblocks.generic.configuremake import obtain_config_guess
from easybuild.framework.easyconfig.constants import EASYCONFIG_CONSTANTS
from easybuild.easyblocks.python import EXTS_FILTER_PYTHON_PACKAGES
from easybuild.framework.easyconfig.constants import EASYCONFIG_CONSTANTS
from easybuild.tools.build_log import EasyBuildError, print_msg
from easybuild.tools.config import build_option, update_build_option
from easybuild.tools.filetools import apply_regex_substitutions, copy_file, remove_file, symlink, which
Expand Down
Loading