Pipelines: Document how to set up scheduled pipelines that can read a sliding window of data

[sarahmaddox]

We'd like a guide that shows how to set up a scheduled pipeline that can read a sliding window of data.

It’s already clear how to set up a pipeline that will read the exact same source data each time it runs. For scheduled pipelines users often want some way (such as a regex) to specify how to read a sliding window of data. This capability exists, but needs to be documented.

A good place for the guide is in the tutorials section:
https://www.kubeflow.org/docs/pipelines/tutorials/

It'd be good if this guide is generic rather than being specific to GCP or any other platform.

[issue-label-bot]

Issue-Label Bot is automatically applying the label improvement/enhancement to this issue, with a confidence of 0.95. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

[sarahmaddox]

See Remote deployment of Kubeflow Pipelines

[sarahmaddox]

/assign @amygdala

[rmgogogo]

/cc rmgogogo

[jtfogarty]

/area docs
/priority p2

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.