Replies: 1 comment 1 reply
-
The scheduler will only catch up for the very first run, it won't because there is a DAGRun already in your DAG above. Try to delete it, then enable it again when the DAG is parsed. Read more here. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm using the catchup=True parameter to run my dag daily when it hasn't run for a few days.
with DAG(
"ingestion_pbi_data_activities",
description=doc.partition(".")[0],
doc_md=doc,
default_args=DEFAULT_ARGS,
schedule_interval="@daily",
start_date=datetime(2024, 10, 1),
max_active_runs=1,
concurrency=2,
catchup=True,
tags=TAGS,
) as dag:
I ran it manually 14/02 and today (17/02) i enabled it again with the idea that the catchup would make the intervals that were missing. It did indeed do that, but for all but the last one it didn't run any tasks.
Is this intended for the catchup parameter? If so what parameters do i need to use to get running tasks for the generated data intervals?
Beta Was this translation helpful? Give feedback.
All reactions