Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Triggering a DAG for a future run(s) stops the intermediate scheduled run(s) #8628

Closed
aishusan opened this issue Apr 29, 2020 · 4 comments
Closed
Labels
area:Scheduler including HA (high availability) scheduler kind:bug This is a clearly a bug pending-response stale Stale PRs per the .github/workflows/stale.yml policy file

Comments

@aishusan
Copy link

aishusan commented Apr 29, 2020

  • Airflow Version: 1.10.9 (We tried it across other versions too, but we see the same behavior!)
  • Python Version: 3.6.0
  • DAG schedule: Every 1 hour once.
  • OS: Mac OS
  • Kernel: Darwin Kernel Version 18.7.0
  • Environment:Local/GCP
  • Kubernetes: Not applicable. We run the plain vanilla version of Airflow using pip installation.

Issue:

At 11.00AM

We triggered a DAG in UI to be scheduled for 2.05 PM (Below are the details)

At 02.30 PM

The job that was scheduled for 2.05 PM ran successfully but we didn't see the 12.00 PM, 1.00 PM and 2.00 PM job's DAG Runs which was supposed to run as per the schedule.
After the 2.05 PM job ran successfully, the rest of the jobs in the schedule seem to run as expected. Say the ones that were supposed to run at 3.00 PM, 4.00 PM, etc.

Details:
State: running
Dag Id: <dag_id>
Execution Date : 2020-04-21 14:05:00
Run Id : scheduled__2020-04-21T14:05:00+00:00

Expectation:

We expected the intermediate DAG Runs at 12.00 PM, 1.00 PM and 2.00 PM to run as expected but we don't see them running.

We posted this the slack channel - https://apache-airflow.slack.com/archives/CCR6P6JRL/p1588075771175300

@aishusan aishusan added the kind:bug This is a clearly a bug label Apr 29, 2020
@boring-cyborg
Copy link

boring-cyborg bot commented Apr 29, 2020

Thanks for opening your first issue here! Be sure to follow the issue template!

@aishusan aishusan changed the title Triggering DAG for a future run stops intermediate the scheduled runs Triggering a DAG for a future run(s) stops the intermediate scheduled run(s) Apr 29, 2020
@eladkal
Copy link
Contributor

eladkal commented Apr 28, 2021

can you please check if it still happens in master?
You are using an old airflow version and also a recent fix of #13434 sounds very similar

@eladkal eladkal added area:Scheduler including HA (high availability) scheduler pending-response labels Apr 28, 2021
@github-actions
Copy link

This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Jun 20, 2021
@github-actions
Copy link

This issue has been closed because it has not received response from the issue author.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler including HA (high availability) scheduler kind:bug This is a clearly a bug pending-response stale Stale PRs per the .github/workflows/stale.yml policy file
Projects
None yet
Development

No branches or pull requests

2 participants