Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Debian: remove force-cgroups-v1 code #338

Merged
merged 4 commits into from
May 29, 2024

Conversation

edsantiago
Copy link
Member

Per discussion in 2024-03-20 Planning meeting, we will no
longer be testing runc in CI. And cgroups V1 is dead too.

Signed-off-by: Ed Santiago santiago@redhat.com

Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240320t171843z-f39f38d13
cache debian c20240320t171843z-f39f38d13
cache fedora c20240320t171843z-f39f38d13
cache fedora-aws c20240320t171843z-f39f38d13
cache fedora-netavark c20240320t171843z-f39f38d13
cache fedora-netavark-aws-arm64 c20240320t171843z-f39f38d13
cache fedora-podman-aws-arm64 c20240320t171843z-f39f38d13
cache fedora-podman-py c20240320t171843z-f39f38d13
cache prior-fedora c20240320t171843z-f39f38d13
cache rawhide c20240320t171843z-f39f38d13
cache win-server-wsl c20240320t171843z-f39f38d13

Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240320t171843z-f39f38d13
cache debian c20240320t171843z-f39f38d13
cache fedora c20240320t171843z-f39f38d13
cache fedora-aws c20240320t171843z-f39f38d13
cache fedora-netavark c20240320t171843z-f39f38d13
cache fedora-netavark-aws-arm64 c20240320t171843z-f39f38d13
cache fedora-podman-aws-arm64 c20240320t171843z-f39f38d13
cache fedora-podman-py c20240320t171843z-f39f38d13
cache prior-fedora c20240320t171843z-f39f38d13
cache rawhide c20240320t171843z-f39f38d13
cache win-server-wsl c20240320t171843z-f39f38d13

@edsantiago
Copy link
Member Author

[Packages are identical to #338]

@edsantiago
Copy link
Member Author

Well, this is not going to be easy.

Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240320t193412z-f39f38d13
cache debian c20240320t193412z-f39f38d13
cache fedora c20240320t193412z-f39f38d13
cache fedora-aws c20240320t193412z-f39f38d13
cache fedora-netavark c20240320t193412z-f39f38d13
cache fedora-netavark-aws-arm64 c20240320t193412z-f39f38d13
cache fedora-podman-aws-arm64 c20240320t193412z-f39f38d13
cache fedora-podman-py c20240320t193412z-f39f38d13
cache prior-fedora c20240320t193412z-f39f38d13
cache rawhide c20240320t193412z-f39f38d13
cache win-server-wsl c20240320t193412z-f39f38d13

Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240514t134014z-f40f39d13
cache debian c20240514t134014z-f40f39d13
cache fedora c20240514t134014z-f40f39d13
cache fedora-aws c20240514t134014z-f40f39d13
cache fedora-netavark c20240514t134014z-f40f39d13
cache fedora-netavark-aws-arm64 c20240514t134014z-f40f39d13
cache fedora-podman-aws-arm64 c20240514t134014z-f40f39d13
cache fedora-podman-py c20240514t134014z-f40f39d13
cache prior-fedora c20240514t134014z-f40f39d13
cache rawhide c20240514t134014z-f40f39d13
cache win-server-wsl c20240514t134014z-f40f39d13

@edsantiago
Copy link
Member Author

debian prior-fedora fedora fedora-aws rawhide
kernel 6.7.12-1 6.8.9-200 6.8.9-300 6.8.9-300 6.9.0-64
6.9.0-0.rc7.20240510git448b3fe5a0ea.62 ⇑
container-selinux ? 2.231.0-1 2.231.0-1 2.230.0-1 2.231.0-1
2.230.0-1 ⇑
passt 2024-04-26 2024-04-26 2024-05-10 2024-05-10 2024-05-10
2024-04-26 ⇑
podman 4.9.4+ds1-1 4.9.4-1 5.0.3-1 5.0.2-1 5.0.3-1
5.0.2-1 ⇑
systemd 255.5-1 254.10-1 255.6-1 255.6-1 256~rc1^20240509git1781de1-2
255.5-1 ⇑

@edsantiago edsantiago marked this pull request as ready for review May 14, 2024 19:58
edsantiago added a commit to edsantiago/libpod that referenced this pull request May 14, 2024
As agreed in Planning meeting of 2024-03-20, Podman 5.x will
drop support for cgroups v1 and for runc. Make it so.

CI images built in containers/automation_images#338

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/libpod that referenced this pull request May 15, 2024
As agreed in Planning meeting of 2024-03-20, Podman 5.x will
drop support for cgroups v1 and for runc. Make it so.

CI images built in containers/automation_images#338

Signed-off-by: Ed Santiago <santiago@redhat.com>
@edsantiago
Copy link
Member Author

@containers/podman-maintainers looks like our days of testing cgroups v1 are numbered. New debian VMs are bringing in new systemd, which refuses to boot under cgroups v1. See #355 for further details.

@mheon
Copy link
Member

mheon commented May 28, 2024

I think that's OK now. We don't release to RHEL8 anymore. 9 can switch to CGv1 but it's not the default. 5 officially deprecated CGv1 support.

@edsantiago
Copy link
Member Author

it's okay, and (per commit message) this was agreed to on March 20 in Planning, but podman tests are going to need some surgery and I've let that slide. Fortunately I have nothing else going on this week[1] so I'll get on that ASAP.

[1] joke. not a funny one.

@Luap99
Copy link
Member

Luap99 commented May 28, 2024

Think of the all the v1/v2 conditionals that we can remove in the tests and eventually the code as well

edsantiago added a commit to edsantiago/libpod that referenced this pull request May 28, 2024
As agreed in Planning meeting of 2024-03-20, Podman 5.x will
drop support for cgroups v1 and for runc. Make it so.

CI images built in containers/automation_images#338

Signed-off-by: Ed Santiago <santiago@redhat.com>
Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240528t194313z-f40f39d13
cache debian c20240528t194313z-f40f39d13
cache fedora c20240528t194313z-f40f39d13
cache fedora-aws c20240528t194313z-f40f39d13
cache fedora-netavark c20240528t194313z-f40f39d13
cache fedora-netavark-aws-arm64 c20240528t194313z-f40f39d13
cache fedora-podman-aws-arm64 c20240528t194313z-f40f39d13
cache fedora-podman-py c20240528t194313z-f40f39d13
cache prior-fedora c20240528t194313z-f40f39d13
cache rawhide c20240528t194313z-f40f39d13
cache win-server-wsl c20240528t194313z-f40f39d13

edsantiago added a commit to edsantiago/libpod that referenced this pull request May 28, 2024
As agreed in Planning meeting of 2024-03-20, Podman 5.x will
drop support for cgroups v1 and for runc. Make it so.

CI images built in containers/automation_images#338

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/buildah that referenced this pull request May 29, 2024
Per consent in 2024-03-20 Planning, remove support for cgroups v1.
And, per discovery on 2024-05-28, systemd 256 no longer even
boots on a cgroups v1 system.

This commit switches to VMs built in:

  containers/automation_images#338

...in which Debian is now cgroups v2 with crun.

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/buildah that referenced this pull request May 29, 2024
Per consent in 2024-03-20 Planning, remove support for cgroups v1.
And, per discovery on 2024-05-28, systemd 256 no longer even
boots on a cgroups v1 system.

This commit switches to VMs built in:

  containers/automation_images#338

...in which Debian is now cgroups v2 with crun.

Requires disabling two conformance tests which fail when run
against docker 26.1; see containers#5526 for context on those.

And, latest git on f40 refuses to serve non-root files when
run as root ("dubious ownership"); so, in start_git_daemon(),
chown the extracted files.

Signed-off-by: Ed Santiago <santiago@redhat.com>
@edsantiago
Copy link
Member Author

debian prior-fedora fedora fedora-aws rawhide
kernel 6.8.11-1 6.8.10-200 6.8.5-301 6.8.5-301 6.9.0-64
6.7.12-1 ⇑ 6.8.9-200 ⇑ 6.8.9-300 ⇑ 6.8.9-300 ⇑ 6.9.0-0.rc7.20240510git448b3fe5a0ea.62 ⇑
buildah 1.33.7+ds1-1 1.35.4-1 1.36.0-1 1.35.4-1 1.35.4-1
1.35.3-1 ⇑ 1.35.4-1 ⇑ 1.35.3-1 ⇑
conmon 2.1.10+ds1-1+b1 2.1.10-1 2.1.12-1 2.1.10-1 2.1.10-1
2.1.10-1 ⇑
container-selinux ? 2.231.0-1 2.231.0-1 2.231.0-1 2.231.0-6
2.230.0-1 ⇑ 2.230.0-1 ⇑ 2.231.0-1 ⇑
containers-common ? 1-99 0.59.0-1 0.58.0-2 0.59.0-1
0.58.0-2 ⇑ 0.58.0-18 ⇑
crun 1.15-1 1.15-1 1.15-1 1.15-1 1.15-1
1.14.4-1 ⇑ 1.14.4-1 ⇑
docker-ce 5:26.1.3-1debian.12bookworm ? ? ? ?
5:26.1.2-1debian.12bookworm ⇑
golang 2:1.22~3 1.21.10-1 1.22.3-1 1.22.3-1 1.22.3-1
1.21.9-1 ⇑ 1.22.2-1 ⇑
passt 2024-04-26 2024-05-10 2024-05-10 2024-05-10 2024-05-23
2024-04-26 ⇑ 2024-04-26 ⇑ 2024-05-10 ⇑
podman 4.9.4+ds1-1 4.9.4-1 5.1.0~rc1-1 5.0.3-1 5.0.3-1
5.0.3-1 ⇑ 5.0.2-1 ⇑ 5.0.2-1 ⇑
skopeo 1.13.3+ds1-2+b1 1.15.0-1 1.15.1-1 1.15.0-1 1.15.1-1
1.15.0-1 ⇑ 1.15.0-1 ⇑
systemd 256~rc3-4 254.12-1 255.7-1 255.6-1 256~rc3-1
255.5-1 ⇑ 254.10-1 ⇑ 255.6-1 ⇑ 255.5-1 ⇑

@edsantiago
Copy link
Member Author

sigh.....

edsantiago and others added 3 commits May 29, 2024 08:10
Per discussion in 2024-03-20 Planning meeting, we will no
longer be testing runc in CI. And cgroups V1 is dead too.

Signed-off-by: Ed Santiago <santiago@redhat.com>
It has been retired in Rawhide, and it's unclear whether
we need it at all.

Signed-off-by: Miloslav Trmač <mitr@redhat.com>
plocate is the default locate implementation in Fedora.

Signed-off-by: Miloslav Trmač <mitr@redhat.com>
Copy link
Member

@cevich cevich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this Ed.

> panic: encoding alphabet includes duplicate symbols

Signed-off-by: Miloslav Trmač <mitr@redhat.com>
Copy link

Cirrus CI build successful. Found built image names and IDs:

Stage Image Name IMAGE_SUFFIX
base debian do-not-use
base fedora do-not-use
base fedora-aws do-not-use
base fedora-aws-arm64 do-not-use
base image-builder do-not-use
base prior-fedora do-not-use
cache build-push c20240529t141726z-f40f39d13
cache debian c20240529t141726z-f40f39d13
cache fedora c20240529t141726z-f40f39d13
cache fedora-aws c20240529t141726z-f40f39d13
cache fedora-netavark c20240529t141726z-f40f39d13
cache fedora-netavark-aws-arm64 c20240529t141726z-f40f39d13
cache fedora-podman-aws-arm64 c20240529t141726z-f40f39d13
cache fedora-podman-py c20240529t141726z-f40f39d13
cache prior-fedora c20240529t141726z-f40f39d13
cache rawhide c20240529t141726z-f40f39d13
cache win-server-wsl c20240529t141726z-f40f39d13

@edsantiago
Copy link
Member Author

debian prior-fedora fedora fedora-aws rawhide
systemd 256~rc3-5 254.12-1 255.7-1 255.7-1 256~rc3-1
256~rc3-4 ⇑ 255.6-1 ⇑

edsantiago added a commit to edsantiago/buildah that referenced this pull request May 29, 2024
Per consent in 2024-03-20 Planning, remove support for cgroups v1.
And, per discovery on 2024-05-28, systemd 256 no longer even
boots on a cgroups v1 system.

This commit switches to VMs built in:

  containers/automation_images#338

...in which Debian is now cgroups v2 with crun.

Requires disabling two conformance tests which fail when run
against docker 26.1; see containers#5526 for context on those.

Also requires disabling two bats tests on debian because
something changed there in ulimits. I'll look into them
later but right now this gives us breathing space.

And, latest git on f40 refuses to serve non-root files when
run as root ("dubious ownership"); so, in start_git_daemon(),
chown the extracted files.

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/buildah that referenced this pull request May 29, 2024
Per consent in 2024-03-20 Planning, remove support for cgroups v1.
And, per discovery on 2024-05-28, systemd 256 no longer even
boots on a cgroups v1 system.

This commit switches to VMs built in:

  containers/automation_images#338

...in which Debian is now cgroups v2 with crun.

Requires disabling two conformance tests which fail when run
against docker 26.1; see containers#5526 for context on those.

Also requires disabling two bats tests on debian because
something changed there in ulimits. I'll look into them
later but right now this gives us breathing space.

And, latest git on f40 refuses to serve non-root files when
run as root ("dubious ownership"); so, in start_git_daemon(),
chown the extracted files.

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/libpod that referenced this pull request May 29, 2024
Another new-VM import from

   containers/automation_images#338

...because the usual conflict dealio in that repo. This
should mostly be a NOP. All the major work was done in containers#22706.

Signed-off-by: Ed Santiago <santiago@redhat.com>
edsantiago added a commit to edsantiago/skopeo that referenced this pull request May 29, 2024
Changes:
  - fix from @mtrmac for go-1.22 panic ("alphabet, duplicate symbols")
  - debian is now cgroupsv2 + crun (does not affect skopeo)
  - many other Red Queen fixes

Built in: containers/automation_images#338

Signed-off-by: Ed Santiago <santiago@redhat.com>
@edsantiago
Copy link
Member Author

CI is passing in podman, buildah, and skopeo.

@edsantiago
Copy link
Member Author

@cevich if you have a moment could you please give a final once-over and then merge? My change is in e509909, all other commits are @mtrmac's from #355. I would like to tag this once it merges. TIA.

Copy link
Member

@cevich cevich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for seeing this through. In my mind at least, there's a bunch of comments and code in podman CI that (when using these images) will confusingly suggest CGv1 is in use. Are there any "cgroupsv1" cleanup/followup issues or cards that need creating?

@cevich cevich merged commit f7bdd13 into containers:main May 29, 2024
39 checks passed
@edsantiago edsantiago deleted the debian_cgroups_v2 branch May 29, 2024 18:39
@edsantiago
Copy link
Member Author

Thank you. Yes, there will be a ton of cleanup needed to remove special-case conditionals. I've chosen not to tackle that yet.

@cevich
Copy link
Member

cevich commented May 29, 2024

I've chosen not to tackle that yet.

That's fine, I or someone else may be able to help with this. I just wanted to know if you had already opened an issue/card or set a personal reminder. I'll go ahead and file a Jira card.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants