Update pip, setuptools, wheel, tox, virtualenv and related packages for Sage 9.5 #32482

`d7161e8`	`build/pkgs/setuptools_scm: Update to 6.3.1`
`c03fd2c`	`build/pkgs/tox: Update to 3.24.3`
`cd402c4`	`build/pkgs/virtualenv: Update to 20.7.2`
`7d15f3f`	`build/pkgs/importlib_resources: Update to 5.2.2`
`23d5ea0`	`build/pkgs/pluggy: Update to 1.0.0`
`92ffb3a`	`build/pkgs/packaging: Update to 21.0`
`ea8b05f`	`build/pkgs/importlib_metadata: Update to 4.8.1`
`eaa5358`	`build/pkgs/pkgconfig: Update to 1.5.5`
`ac16b98`	`build/pkgs/six: Update to 1.16.0`
`4b1a1af`	`build/pkgs/wheel: Update to 0.37.0`

sagetrac-git · 2021-09-06T19:39:39Z

Changed commit from 80ad6ba to 4b1a1af

mkoeppe · 2021-09-06T19:42:47Z

comment:4

Our patch build/pkgs/setuptools/patches/distutils-big-sur-6511bf56.patch (workaround for MACOSX_DEPLOYMENT_TARGET=11, added in #31335) no longer applies. The code has changed a lot and is now in (https://github.com/pypa/setuptools/blob/1ba66c1d79bf2e89d1d7be426bde60298c9439cd/setuptools/_distutils/util.py#L140). I don't see the workaround reflected by the new code.

mkoeppe · 2021-09-06T19:50:14Z

comment:5

(from #31335 comment:36)
Upstream cpython issue: https://bugs.python.org/issue42504

mkoeppe · 2021-09-06T19:59:20Z

comment:6

apparently fixed in upstream cpython 3.10 (python/cpython#24341), 3.9.2 (python/cpython#24410), 3.8.10 (python/cpython#25806)

sagetrac-git · 2021-09-06T20:06:48Z

Branch pushed to git repo; I updated commit sha1. New commits:

`0f7da4f`	`build/pkgs/setuptools/patches/distutils-big-sur-6511bf56.patch: Remove`

sagetrac-git · 2021-09-06T20:06:48Z

Changed commit from 4b1a1af to 0f7da4f

sagetrac-git · 2021-09-06T20:38:54Z

Branch pushed to git repo; I updated commit sha1. New commits:

`59132ab`	`build/pkgs/tomli: New, dependency of setuptools_scm`
`7ebcb6c`	`build/pkgs/setuptools_scm/dependencies: Add packaging`
`2def651`	`build/pkgs/{packaging,pyparsing,setuptools_scm}/dependencies: Avoid circular deps`

sagetrac-git · 2021-09-06T20:38:54Z

Changed commit from 0f7da4f to 2def651

mkoeppe · 2021-09-06T20:42:29Z

comment:9

Running into a strange circular dependency for packaging

packaging-21.0] Installing packaging-21.0
[packaging-21.0] Processing /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/var/tmp/sage/build/packaging-21.0/src
[packaging-21.0]     Preparing wheel metadata: started
[packaging-21.0]     Running command /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/bin/python3 /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py prepare_metadata_for_build_wheel /var/folders/38/wnh4gf1552g_crsjnv2vmmww0000gp/T/tmpk9l4wmep
[packaging-21.0]     Traceback (most recent call last):
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 349, in <module>
[packaging-21.0]         main()
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 331, in main
[packaging-21.0]         json_out['return_val'] = hook(**hook_input['kwargs'])
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 151, in prepare_metadata_for_build_wheel
[packaging-21.0]         return hook(metadata_directory, config_settings)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/build_meta.py", line 166, in prepare_metadata_for_build_wheel
[packaging-21.0]         self.run_setup()
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/build_meta.py", line 150, in run_setup
[packaging-21.0]         exec(compile(code, __file__, 'exec'), locals())
[packaging-21.0]       File "setup.py", line 40, in <module>
[packaging-21.0]         setup(
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/__init__.py", line 153, in setup
[packaging-21.0]         return distutils.core.setup(**attrs)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 108, in setup
[packaging-21.0]         _setup_distribution = dist = klass(attrs)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/dist.py", line 450, in __init__
[packaging-21.0]         _Distribution.__init__(
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 293, in __init__
[packaging-21.0]         self.finalize_options()
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/dist.py", line 827, in finalize_options
[packaging-21.0]         for ep in sorted(loaded, key=by_order):
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/setuptools/dist.py", line 826, in <lambda>
[packaging-21.0]         loaded = map(lambda e: e.load(), filtered)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pkg_resources/__init__.py", line 2449, in load
[packaging-21.0]         self.require(*args, **kwargs)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pkg_resources/__init__.py", line 2472, in require
[packaging-21.0]         items = working_set.resolve(reqs, env, installer, extras=self.extras)
[packaging-21.0]       File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pkg_resources/__init__.py", line 772, in resolve
[packaging-21.0]         raise DistributionNotFound(req, requirers)
[packaging-21.0]     pkg_resources.DistributionNotFound: The 'packaging>=20.0' distribution was not found and is required by the application
[packaging-21.0]     Preparing wheel metadata: finished with status 'error'
[packaging-21.0] WARNING: Discarding file:///Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/var/tmp/sage/build/packaging-21.0/src. Command errored out with exit status 1: /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/bin/python3 /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py prepare_metadata_for_build_wheel /var/folders/38/wnh4gf1552g_crsjnv2vmmww0000gp/T/tmpk9l4wmep Check the logs for full command output.
[packaging-21.0] ERROR: Command errored out with exit status 1: /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/bin/python3 /Users/mkoeppe/s/sage/sage-rebasing/worktree-gcc11/local/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py prepare_metadata_for_build_wheel /var/folders/38/wnh4gf1552g_crsjnv2vmmww0000gp/T/tmpk9l4wmep Check the logs for full command output.
[packaging-21.0] ********************************************************************************
[packaging-21.0] Error building a wheel for packaging-21.0

mkoeppe · 2021-09-06T20:48:59Z

comment:10

This went away by doing make setuptools_scm-clean

mkoeppe · 2021-09-06T20:53:10Z

Reviewer: https://github.com/mkoeppe/sage/actions/runs/1207212805, https://github.com/mkoeppe/sage/actions/runs/1207212806

mkoeppe · 2021-09-06T20:53:10Z

Author: Matthias Koeppe

mkoeppe · 2021-09-07T00:42:45Z

comment:12

  [tomli-1.2.1]   ModuleNotFoundError: No module named 'flit_core'

mkoeppe · 2021-09-07T00:45:06Z

comment:13

... so need #32483 or #31280

mkoeppe · 2021-09-09T03:29:05Z

Dependencies: #31280, #32493

sagetrac-git · 2021-09-09T03:29:57Z

Changed commit from 2def651 to aceeeeb

sagetrac-git · 2021-09-09T03:29:57Z

Branch pushed to git repo; I updated commit sha1. Last 10 new commits:

`e2fb5ce`	`build/pkgs/ipywidgets: Update to 7.6.4`
`3e2fb34`	`Merge #31280`
`00f06a6`	`build/pkgs/{bleach,html5lib,importlib_resources,sagenb_export}/dependencies: Add missing deps`
`ac8bce8`	`Merge #31280`
`a15e3eb`	`build/pkgs/{flit_core,jupyterlab_pygments,matplotlib_inline,nbclient,nbconvert}/dependencies: Add missing deps`
`dc094c0`	`build/pkgs/{ipykernel,nbconvert}/dependencies: Add missing deps`
`c929321`	`build/pkgs/nbclient/dependencies: fixup`
`41224af`	`build/pkgs/nbconvert/dependencies: Add missing dep`
`0fc01d3`	`build/pkgs/zipp: Update to 3.5.0`
`aceeeeb`	`Merge #32493`

sagetrac-git · 2021-09-09T03:32:26Z

Changed commit from aceeeeb to bf15a7b

sagetrac-git · 2021-09-09T03:32:26Z

Branch pushed to git repo; I updated commit sha1. New commits:

`bf15a7b`	`build/pkgs/tomli/dependencies: Add flit_core`

sagetrac-git · 2021-09-09T03:49:44Z

Changed commit from bf15a7b to f10ea0b

sagetrac-git · 2021-09-09T03:49:44Z

Branch pushed to git repo; I updated commit sha1. New commits:

`432699d`	`build/pkgs/flit_core/dependencies: Remove dep on toml again, replace PYTHON_TOOLCHAIN by pip only, to break circular dep`
`f10ea0b`	`build/pkgs/tomli/dependencies: Replace PYTHON_TOOLCHAIN by pip only, to break circular dep`

sagetrac-git · 2021-09-09T03:54:17Z

Changed commit from f10ea0b to 4bdbddd

sagetrac-git · 2021-09-09T03:54:17Z

Branch pushed to git repo; I updated commit sha1. New commits:

`4bdbddd`	`build/pkgs/tomli/dependencies: Add toml because flit_core needs it at its runtime`

mkoeppe · 2021-09-09T04:59:20Z

Changed reviewer from https://github.com/mkoeppe/sage/actions/runs/1207212805, https://github.com/mkoeppe/sage/actions/runs/1207212806 to none

sagetrac-git · 2021-09-14T02:08:39Z

Branch pushed to git repo; I updated commit sha1. New commits:

`6b64599`	`Merge tag '9.5.beta1' into t/32482/update_pip_to_21_2_4`

sagetrac-git · 2021-09-14T02:08:39Z

Changed commit from 4bdbddd to 6b64599

mkoeppe · 2021-09-14T02:09:10Z

Changed dependencies from #31280, #32493 to #32493

mkoeppe · 2021-09-14T02:19:15Z

Reviewer: https://github.com/mkoeppe/sage/actions/runs/1231955852, https://github.com/mkoeppe/sage/actions/runs/1231955857, https://github.com/mkoeppe/sage/actions/runs/1231955859

jhpalmieri · 2021-09-15T20:04:42Z

Changed reviewer from https://github.com/mkoeppe/sage/actions/runs/1231955852, https://github.com/mkoeppe/sage/actions/runs/1231955857, https://github.com/mkoeppe/sage/actions/runs/1231955859 to John Palmieri

jhpalmieri · 2021-09-15T20:04:42Z

comment:24

This looks good to me.

mkoeppe · 2021-09-15T21:23:18Z

comment:25

Thank you!

vbraun · 2021-09-19T09:57:57Z

Changed branch from u/mkoeppe/update_pip_to_21_2_4 to 6b64599

mkoeppe added this to the sage-9.5 milestone Sep 6, 2021

mkoeppe added c: packages: standard labels Sep 6, 2021

This comment has been minimized.

Sign in to view

mkoeppe changed the title ~~Update pip to 21.2.4~~ Update pip, setuptools, wheel, tox, virtualenv and related packages for Sage 9.5 Sep 6, 2021

mkoeppe added the s: needs review label Sep 6, 2021

mkoeppe added s: needs work and removed s: needs review labels Sep 7, 2021

mkoeppe added s: needs review and removed s: needs work labels Sep 9, 2021

jhpalmieri added s: positive review and removed s: needs review labels Sep 15, 2021

vbraun removed the s: positive review label Sep 19, 2021

vbraun closed this as completed in 3d02cb2 Sep 19, 2021

Update pip, setuptools, wheel, tox, virtualenv and related packages for Sage 9.5 #32482

Update pip, setuptools, wheel, tox, virtualenv and related packages for Sage 9.5 #32482

Comments

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

This comment has been minimized.

sagetrac-git mannequin commented Sep 6, 2021

sagetrac-git mannequin commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

sagetrac-git mannequin commented Sep 6, 2021

sagetrac-git mannequin commented Sep 6, 2021

sagetrac-git mannequin commented Sep 6, 2021

sagetrac-git mannequin commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 6, 2021

mkoeppe commented Sep 7, 2021

mkoeppe commented Sep 7, 2021

mkoeppe commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

sagetrac-git mannequin commented Sep 9, 2021

mkoeppe commented Sep 9, 2021

sagetrac-git mannequin commented Sep 14, 2021

sagetrac-git mannequin commented Sep 14, 2021

mkoeppe commented Sep 14, 2021

mkoeppe commented Sep 14, 2021

jhpalmieri commented Sep 15, 2021

jhpalmieri commented Sep 15, 2021

mkoeppe commented Sep 15, 2021

vbraun commented Sep 19, 2021