Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for --delete-offsets for consumer group topic #1912

Closed
alok87 opened this issue Apr 9, 2021 · 2 comments
Closed

Support for --delete-offsets for consumer group topic #1912

alok87 opened this issue Apr 9, 2021 · 2 comments
Labels
stale Issues and pull requests without any recent activity

Comments

@alok87
Copy link

alok87 commented Apr 9, 2021

Problem Description

Explaining the problem with an example:

ConsumerGroupA has topicA, and after few days we move the topicA to ConsumerGroupB due to some use case. Since the retention is infinite for this use cases the ConsumerGroupA for topicA stays active. The lag dashboards keep showing the lag for this dead topic group.

Since other topics are still using ConsumerGroupA we cannot delete the ConsumerGroupA.
We just want to delete the topicA from ConsumerGroupA.

Problems:

  • The alerts set on the lags result in false alerts due to this. As the alerts come for the dead topic/consumerGroup.
  • The lag dashboards becomes noisy due to this.

Based on this stackoverflow answer, Kafka 2.4.0+ has support to delete individual consumer group id offsets from a topic which should solve this problem.

./kafka-consumer-groups.sh \
  --bootstrap-server kafka.{env}.elinvar.tech:9092 \
  --delete-offsets \
  --group {my-group} \
  --topic topicName0

KAFKA KIP for --delete-offset
This has a great detail about this problem.
https://cwiki.apache.org/confluence/display/KAFKA/KIP-496%3A+Administrative+API+to+delete+consumer+offsets

Support request

Is it possible to add support for --delete-offsets in Sarama?

@alok87 alok87 changed the title Support to delete a consumer group ID offset from a topic Support for --delete-offsets for consumer group topic Apr 9, 2021
@github-actions

This comment was marked as outdated.

@github-actions github-actions bot added the stale Issues and pull requests without any recent activity label Aug 26, 2023
@dnwe
Copy link
Collaborator

dnwe commented Aug 29, 2023

Available in v1.30.0 and newer since #2006 merged

@dnwe dnwe closed this as completed Aug 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale Issues and pull requests without any recent activity
Projects
None yet
Development

No branches or pull requests

2 participants