Skip to content
This repository has been archived by the owner on Jun 28, 2024. It is now read-only.

tests: nydus: Skip tests when using dragonball #5771

Open
fidencio opened this issue Sep 18, 2023 · 1 comment
Open

tests: nydus: Skip tests when using dragonball #5771

fidencio opened this issue Sep 18, 2023 · 1 comment
Labels
bug Incorrect behaviour needs-review Needs to be assessed by the team.

Comments

@fidencio
Copy link
Member

When updating nydus to 2.2.3 and nydus-snapshotter to 0.12.0, some work will be needed on dragonball side as the nydus tests are failing there with the following error:

09:55:09 INFO: Running nydus test
09:55:09 bash -f integration/nydus/nydus_tests.sh
09:55:09 Running setup
09:55:09 Download tarball from https://github.com/dragonflyoss/image-service/releases/download/v2.2.3/nydus-static-v2.2.3-linux-amd64.tgz
09:55:10 Download tarball from https://github.com/containerd/nydus-snapshotter/releases/download/v0.12.0/nydus-snapshotter-v0.12.0-x86_64.tgz
09:55:11 Enabling all debug options in file /etc/kata-containers/configuration.toml
09:55:11 [debug]
09:55:11   level = "debug"
09:55:11 [proxy_plugins]
09:55:11   [proxy_plugins.nydus]
09:55:11     type = "snapshot"
09:55:11     address = "/run/containerd-nydus/containerd-nydus-grpc.sock"
09:55:11 [plugins]
09:55:11   [plugins.cri]
09:55:11     disable_hugetlb_controller = false
09:55:11     [plugins.cri.containerd]
09:55:11       snapshotter = "nydus"
09:55:11       disable_snapshot_annotations = false
09:55:11       [plugins.cri.containerd.runtimes]
09:55:11       [plugins.cri.containerd.runtimes.runc]
09:55:11          runtime_type = "io.containerd.runc.v2"
09:55:11          [plugins.cri.containerd.runtimes.runc.options]
09:55:11            BinaryName = "/usr/local/sbin/runc"
09:55:11            Root = ""
09:55:11       [plugins.cri.containerd.runtimes.kata]
09:55:11          runtime_type = "io.containerd.kata.v2"
09:55:11          privileged_without_host_devices = true
09:55:11 INFO: restart containerd service
09:55:12 nydus-snapshotter is running
09:55:12 Running nydus integration tests
09:55:13 Image is up to date for sha256:dcac4621b8636ac822ab7737648a272fcf378b8df6d315816036f00d5536d1e2
09:55:15 Pod 47232412d47a6af55dff6659a287aef9e625ba417f6aa690b96254c3dac4ec18 created
09:55:16 Container 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67 created
09:55:16 time="2023-09-18T07:55:16Z" level=fatal msg="starting the container \"95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: Others(\"failed to handler message create container\\n\\nCaused by:\\n    0: create\\n    1: handler rootfs\\n    2: new nydus rootfs\\n    3: failed to do rafs mount\\n    4: fail to attach rafs \\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"\\n    5: add share fs mount\\n    6: Mount rafs at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower error: Failed to Mount backend Some(\\\"rafs\\\") at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower mount config FsMountConfigInfo { ops: \\\"mount\\\", fstype: Some(\\\"rafs\\\"), source: Some(\\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"), mountpoint: \\\"/rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower\\\", config: Some(\\\"{\\\\\\\"device\\\\\\\":{\\\\\\\"backend\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"registry\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"readahead\\\\\\\":false,\\\\\\\"host\\\\\\\":\\\\\\\"ghcr.io\\\\\\\",\\\\\\\"repo\\\\\\\":\\\\\\\"dragonflyoss/image-service/alpine\\\\\\\",\\\\\\\"proxy\\\\\\\":{\\\\\\\"fallback\\\\\\\":false},\\\\\\\"timeout\\\\\\\":5,\\\\\\\"connect_timeout\\\\\\\":5,\\\\\\\"retry_limit\\\\\\\":2}},\\\\\\\"cache\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"blobcache\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"work_dir\\\\\\\":\\\\\\\"/var/lib/containerd-nydus/cache\\\\\\\",\\\\\\\"disable_indexed_map\\\\\\\":false}}},\\\\\\\"mode\\\\\\\":\\\\\\\"direct\\\\\\\",\\\\\\\"digest_validate\\\\\\\":false,\\\\\\\"enable_xattr\\\\\\\":true,\\\\\\\"fs_prefetch\\\\\\\":{\\\\\\\"enable\\\\\\\":true,\\\\\\\"prefetch_all\\\\\\\":true,\\\\\\\"threads_count\\\\\\\":8,\\\\\\\"merging_size\\\\\\\":1048576,\\\\\\\"bandwidth_rate\\\\\\\":0}}\\\"), tag: \\\"kataShared\\\", prefetch_list_path: None, dax_threshold_size_kb: None }\\n       \\n       Caused by:\\n           vmm action error: FsDevice(AttachBackendFailed(\\\"attach/detach a backend filesystem failed:: missing field `version` at line 1 column 489\\\"))\"): unknown"
09:55:16 [nydus_tests.sh:164] ERROR: sudo -E crictl start 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67
09:55:16 Running teardown
09:55:16 integration/nydus/nydus_tests.sh: line 189: 29579 Killed                  nohup /usr/local/bin/containerd-nydus-grpc --config /etc/snapshotter-config.toml --nydusd-config /etc/nydusd-config.json --log-to-stdout > /dev/null 2>&1

/cc @studychao @ChengyuZhu6

@fidencio fidencio added bug Incorrect behaviour needs-review Needs to be assessed by the team. labels Sep 18, 2023
fidencio added a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
@stevenhorsman
Copy link
Member

When we get this resolved and re-enable the test we'll need to be aware to remove the skip in kata-containers tests (introduced in kata-containers/kata-containers@aea39f8) as well

fidencio added a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Incorrect behaviour needs-review Needs to be assessed by the team.
Projects
None yet
Development

No branches or pull requests

2 participants