Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build docker failed with 401 Unauthorized (Set Up the Development Environment With Merlin Containers) #434

Open
SeekPoint opened this issue Dec 7, 2023 · 4 comments
Assignees

Comments

@SeekPoint
Copy link

With the guild of Set Up the Development Environment With Merlin Containers

https://nvidia-merlin.github.io/HugeCTR/main/hugectr_contributor_guide.html#set-up-the-development-environment-with-merlin-containers

/HugeCTR/Merlin/docker$ sudo docker build --pull -t merlin:ctr -f dockerfile.ctr --build-arg RELEASE=false --build-arg RMM_VER=vnightly --build-arg CUDF_VER=vnightly --build-arg NVTAB_VER=vnightly --build-arg HUGECTR_DEV_MODE=true --no-cache .
[sudo] password for amd00:
[+] Building 2.3s (7/7) FINISHED docker:default
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load build definition from dockerfile.ctr 0.0s
=> => transferring dockerfile: 3.54kB 0.0s
=> resolve image config for docker.io/docker/dockerfile:1.2 1.3s
=> CACHED docker-image://docker.io/docker/dockerfile:1.2@sha256:e2a8561e419ab1ba6b2fe6cbdf49fd92b95912df1cf7d313c3e2230a333fdbcc 0.0s
=> [internal] load build definition from dockerfile.ctr 0.0s
=> [internal] load .dockerignore 0.0s
=> ERROR [internal] load metadata for nvcr.io/nvstaging/merlin/merlin-base:23.06 0.8s

[internal] load metadata for nvcr.io/nvstaging/merlin/merlin-base:23.06:


dockerfile.ctr:1

1 | >>> # syntax=docker/dockerfile:1.2
2 | ARG MERLIN_VERSION=23.06
3 | ARG TRITON_VERSION=23.06

ERROR: failed to solve: pulling from host nvcr.io failed with status code [manifests 23.06]: 401 Unauthorized
amd00@MZ32-00:~/yk_repo/HugeCTR/Merlin/docker$

@EmmaQiaoCh EmmaQiaoCh self-assigned this Dec 8, 2023
@EmmaQiaoCh
Copy link
Collaborator

Hi @SeekPoint, Thanks for trying hugectr.
Registry 'nvcr.io/nvstaging' can only be used internally. The merlin-base could be built from dockerfile.merlin(same path as dockerfile.ctr). Then pass the --build-arg BASE_IMAGE=$image_tag_built_from_dockerfile.merlin when docker build dockerfile.ctr.

@SeekPoint
Copy link
Author

so, what the exact steps for set up a dev environments for external developer?

@SeekPoint
Copy link
Author

I try to build HugeCTR from source on the image which I build with
"
Merlin/docker$
sudo docker build --pull -f dockerfile.merlin .
"
I it falied with

@SeekPoint
Copy link
Author

the I try:

(base) amd00@MZ32-00:~/yk_repo/HugeCTR/Merlin/docker$ sudo docker build --pull -f dockerfile.ctr .
[+] Building 3.6s (7/7) FINISHED docker:default
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load build definition from dockerfile.ctr 0.0s
=> => transferring dockerfile: 3.50kB 0.0s
=> resolve image config for docker.io/docker/dockerfile:1.2 2.0s
=> CACHED docker-image://docker.io/docker/dockerfile:1.2@sha256:e2a8561e419ab1ba6b2fe6cbdf49fd92b95912df1cf7d313c3e2230a333fdbcc 0.0s
=> [internal] load build definition from dockerfile.ctr 0.0s
=> [internal] load .dockerignore 0.0s
=> ERROR [internal] load metadata for docker.io/library/dockerfile.merlin:latest 1.4s

[internal] load metadata for docker.io/library/dockerfile.merlin:latest:


dockerfile.ctr:1

1 | >>> # syntax=docker/dockerfile:1.2
2 | ARG MERLIN_VERSION=23.06
3 | ARG TRITON_VERSION=23.06

ERROR: failed to solve: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
(base) amd00@MZ32-00:~/yk_repo/HugeCTR/Merlin/docker$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants