Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate all packages to use PEP 517 #16144

Closed
wants to merge 2 commits into from
Closed

Conversation

uranusjr
Copy link
Member

The main Airflow and all provider packages are now using pyproject.toml's [build-system] to specify build-time requirements, and use https://github.com/pypa/build to build sdist and wheel.

TBH I kind of lost track half way of what I should change in the build system. I don't have much confidence of some changes I've made.

cc @potiuk


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@uranusjr uranusjr marked this pull request as ready for review May 28, 2021 16:24
@uranusjr uranusjr requested review from ashb, kaxil and potiuk as code owners May 28, 2021 16:24
@potiuk
Copy link
Member

potiuk commented May 28, 2021

The tests will show. All the build commands (including building providers) are executed in CI :)

@uranusjr uranusjr force-pushed the pep-517 branch 8 times, most recently from 853822c to 589711b Compare May 29, 2021 12:34
Since we need to run things before building a dist (namely
compile_assets and build-tagging), a custom PEP 517 backend is created
to do them instead of standalone setup.py commands in the shell script.
This make the pyproject.toml distinct from the parent airflow package
since they now have different build dependencies. A custom build backend
is also created to handle build tagging.
@uranusjr
Copy link
Member Author

Things seem to work...?

@uranusjr
Copy link
Member Author

Since compile_assets is now called inside the PEP 517 hook, we can now move it from setup.py into scripts/pep517/backend.py, but would some people still want to call setup.py compile_assets?

@uranusjr
Copy link
Member Author

This seems to break editable install. Need more investigation.

@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Jul 17, 2021
@github-actions github-actions bot closed this Jul 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:dev-tools stale Stale PRs per the .github/workflows/stale.yml policy file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants