Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

changefeedccl: observability into catch up time #92622

Open
amruss opened this issue Nov 28, 2022 · 2 comments
Open

changefeedccl: observability into catch up time #92622

amruss opened this issue Nov 28, 2022 · 2 comments
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc

Comments

@amruss
Copy link
Contributor

amruss commented Nov 28, 2022 •
edited by exalate-issue-sync bot
Loading

When we are catching up, we should give an indication into how much time it will take to catch up (rate of incoming - rate of outgoing * messages). This may be something to add to the insights page, with a recommendation that you increase your kafka quota.

Related:

Jira issue: CRDB-21887
@amruss amruss added the C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) label Nov 28, 2022
@blathers-crl blathers-crl bot added the T-cdc label Nov 28, 2022
@blathers-crl
Copy link

blathers-crl bot commented Nov 28, 2022

cc @cockroachdb/cdc

@amruss
Copy link
Contributor Author

amruss commented Dec 21, 2022 •
edited
Loading

Note: we block when we can't emit, so the incoming will always be less... the pushback counter is what we care about here. Pushback counter is measuring how much time we've been pushing back...

Suggestion: Gauge that says I'm in pushback. You can monitor for this: if in pushback for more than X minutes alert on this

  • pusback can be produced by aggregator... vs high watermark is only at the frontier level

@rharding6373 rharding6373 added the A-cdc Change Data Capture label May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rharding6373 @amruss