Add support for Python 3.13

[cdce8p]

Breaking change

The profiler.memory service is not available when using Python 3.13. It will return if and when guppy3 becomes Python 3.13 compatible.

Proposed change

Add initial support for Python 3.13.
The following integrations don't work yet.

• Anthropic depends on tokenizers => fixed with 0.20.3
  Python 3.13 support huggingface/tokenizers#1639
  PyO3 0.22 huggingface/tokenizers#1665
  Tokenizers v0.20.2 fails on batches as tuples huggingface/tokenizers#1672
• Comelit SimpleHome and WeatherFlow depend on Pint
  Python 3.13 error: cannot inherit frozen dataclass from a non-frozen one hgrecco/pint#1969
  TypeError in python 3.13 hgrecco/pint#2065
  pint 0.24.3 - Python 3.11.9 error: cannot inherit frozen dataclass from a non-frozen one hgrecco/pint#2074
  Use dataclass(frozen=True) for compatibility with Python 3.13 (incomplete, needs help) hgrecco/pint#2037
  Convert ParsingError to dataclass(frozen=False) hgrecco/flexparser#12
  Remove temporary pint constraint #130070
• Profiler depends (partially) on guppy3==3.1.3
  Error building wheel for Python 3.13
  https://github.com/zhuyifei1999/guppy3
• Environment Canada, EZVIZ, Kraken, NOAA Tides depend on pandas>=2.2.0
  which can't be build on armv7, i386.
  BUILD: Install regression on armv7 pandas-dev/pandas#59905
  BLD: Fix armv7 build pandas-dev/pandas#59906
  Backport PR #59906 on branch 2.3.x (BLD: Fix armv7 build) pandas-dev/pandas#59937
  RLS: 2.3 pandas-dev/pandas#59664
  Update numpy to 2.1.2 and pandas to 2.2.3 #129958
• Huum depends on huum==0.7.11 => fixed with 0.7.12
  Remove upper version constraint for Python frwickst/pyhuum#10
  Update huum to 0.7.12 #130527

PEP 594 removed a lot of "dead" batteries from the stdlib. Unfortunately, those are not quite dead yet and a lot of integrations and dependencies still use them. Fortunately there are backport libraries available which we can use instead. At some point, we might want to remove them as well, but they certainly make the transition easier.

Additional dependencies

• audioop-lts
  https://github.com/AbstractUmbra/audioop

  • Assist pipeline
  • Tami4 Edge / Edge+ -> Tami4EdgeAPI -> PyPasser -> pydub==0.25.1
    audioop deprecation - Python 3.12 jiaaro/pydub#725
  • Voice over IP -> voip-utils==0.1.0
    https://github.com/home-assistant-libs/voip-utils

• standard-aifc, standard-imghdr and standard-telnetlib
  https://github.com/youknowone/python-deadlib

  • aifc used by:
    • Tami4 Edge / Edge+ -> Tami4EdgeAPI -> PyPasser -> SpeechRecognition==3.8.1
      => fixed with 3.12.0
      The python 'aifc' library is removed in python 3.13.0 Uberi/speech_recognition#775
      Install aifc and audioop in Python 3.13 Uberi/speech_recognition#781
  • imghdr used by:
    • Apple TV -> pyatv -> mediafile==0.12.0 => fixed with 0.13.0
imghdr is deprecated and slated for removal in Python 3.13 beetbox/mediafile#67
      Replace deprecated imghdr package with filetype beetbox/mediafile#75
  • telnetlib used by:
    • Discord -> nextcord==2.6.0
      DeprecationWarning: 'audioop' is deprecated and slated for removal in Python 3.13 nextcord/nextcord#1174
    • Keenetic NDMS2 Router -> ndms2-client==0.1.2
      Switch from telnet to API foxel/python_ndms2_client#6
      Introduce api connection foxel/python_ndms2_client#8
    • Plum Lightpad -> plumlightpad==0.0.11
      Lightpad TCP connection should be asyncio aware heathbar/plum-lightpad-python#7
    • Soundavo WS66i 6-Zone Amplifier -> pyws66i==1.1
      https://github.com/ssaenger/pyws66i
    • Actiontec
    • Denon Network Receivers
    • hddtemp
    • Pioneer
    • Telnet
    • Thomson

--
For reference the Python 3.12 update:

• Add support for Python 3.12 #101651

Type of change

• Dependency upgrade
• Bugfix (non-breaking change which fixes an issue)
• New integration (thank you!)
• New feature (which adds functionality to an existing integration)
• Deprecation (breaking change to happen in the future)
• Breaking change (fix/feature causing existing functionality to break)
• Code quality improvements to existing code or addition of tests

Additional information

• This PR fixes or closes issue: fixes #
• This PR is related to issue:
• Link to documentation pull request:

Checklist

• The code change is tested and works locally.
• Local tests pass. Your PR cannot be merged unless tests pass
• There is no commented out code in this PR.
• I have followed the development checklist
• I have followed the perfect PR recommendations
• The code has been formatted using Ruff (ruff format homeassistant tests)
• Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

• Documentation added/updated for www.home-assistant.io

If the code communicates with devices, web services, or third-party tools:

• The manifest file has all fields filled out correctly.
  Updated and included derived files by running: python3 -m script.hassfest.
• New or updated dependencies have been added to requirements_all.txt.
  Updated by running python3 -m script.gen_requirements_all.
• For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.

To help with the load of incoming pull requests:

• I have reviewed two other open pull requests in this repository.

[cdce8p]

The PR is ready now! Wheels will follow once the base image and wheel builder have been updated.

[bdraco]

LGTM, should we wait until after we ship 2024.11.0?

[edenhaus]

LGTM, should we wait until after we ship 2024.11.0?

In my opinion, we should wait, as this PR could create potential merge conflicts with the RC

[cdce8p]

In my opinion, we should wait, as this PR could create potential merge conflicts with the RC

I don't think this is an issue here. All three of the integrations modified here are quite stable. There is only one PR to add a new platform to comelit which could be impacted but it's still in draft: #125154.

Overall, merge conflicts should be similar to other PRs and easy to resolve.

An alternative of course would be to just cherry-pick this one as that would completely eliminate any potential conflicts. It doesn't need to be mentioned in the release notes quite yet but users would still be able to try out 3.13 early if they want to.

[cdce8p]

tokenizers released a 3.13 compatible version today, so we no longer need to disable Anthropic. Furthermore, mediafile no longer depends on the (removed) imghdr package. So the added dependency on standard-imghdr could also be removed.

Will update the PR again tomorrow, once the (unrelated) CI issue is fixed.

[cdce8p]

The PR is ready now. After the pint release, we only need to disable one profiler service for Python 3.13 now. Everything else should continue to work just fine🤞🏻

[frenck]

This test seems to be failing consistently on the Python 3.13 CI right now:

../Frenck

[home-assistant]

Please take a look at the requested changes, and use the Ready for review button when you are done, thanks 👍

Learn more about our pull request process.

[cdce8p]

This test seems to be failing consistently on the Python 3.13 CI right now:

Not sure yet what's going on there. The test passes locally and also on my fork. It seems to be a bit flaky. Interesting that it's only 3.13 though.

[cdce8p]

The flaky modbus test issue is now resolve.

Just pushed the last updates:

• Since the last time, I needed to temporarily disable the Huum integration as it pins <3.13. Opened a PR to get this fixed hopefully soon. We can revert the partial disable then. /CC @frwickst
  Remove upper version constraint for Python frwickst/pyhuum#10
• Added cp313 to the wheel builder. The wheels for 3.13 are (almost) all already available on
  https://wheels.home-assistant.io/musllinux/
  An up-to-date wheel builder run: https://github.com/home-assistant/core/actions/runs/11759808225
• Pydantic v1 doesn't support cython >3 which is required for Python 3.13. We can still use it, just have to fall back to the (slower) pure Python version for 3.13 ( -> pydantic-1.10.18-py3-none-any.whl). /CC @joostlek
  https://github.com/pydantic/pydantic/blob/v1.10.18/setup.py#L82-L83
  Pydantic v2 migration issue #99218

IMO this PR is ready now. The few open items (mainly Huum and eventually guppy3) can be addressed later.

[frenck]

Thanks, @cdce8p 🎉

Here we go 🚀

../Frenck