Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fail backfill command before loading DAGs if missing args #18994

Merged
merged 1 commit into from
Oct 15, 2021

Conversation

SamWheating
Copy link
Contributor

I was looking through some of the CLI code last week trying to improve the speed of airflow user commands and I noticed this small issue.

If neither the start_date or end_date argument is provided then the command will fail, but it will first parse all of the DAGs which can take up to several minutes in large deployments.

Now the command will fail faster, allowing the user to adjust their command and retry.

@github-actions
Copy link

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

@github-actions github-actions bot added the okay to merge It's ok to merge this PR as it does not require more tests label Oct 15, 2021
@kaxil kaxil merged commit b814ab4 into apache:main Oct 15, 2021
@kaxil kaxil added this to the Airflow 2.2.1 milestone Oct 15, 2021
jedcunningham pushed a commit that referenced this pull request Oct 15, 2021
…18994)

I was looking through some of the CLI code last week trying to improve the speed of `airflow user` commands and I noticed this small issue.

If neither the `start_date` or `end_date` argument is provided then the command will fail, but it will first parse all of the DAGs which can take up to several minutes in large deployments.

Now the command will fail faster, allowing the user to adjust their command and retry.

(cherry picked from commit b814ab4)
@jedcunningham jedcunningham added the type:bug-fix Changelog: Bug Fixes label Apr 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:CLI okay to merge It's ok to merge this PR as it does not require more tests type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants