-
Notifications
You must be signed in to change notification settings - Fork 805
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Differentiate metrics for domainTagged metrics and task operation metrics #3467
Differentiate metrics for domainTagged metrics and task operation metrics #3467
Conversation
3995fdd
to
5c4281e
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please take a look at how metricRollupName
works: https://github.com/uber/cadence/blob/master/common/metrics/defs.go#L2098
It can make code much cleaner as we only need to call IncCounter() or RecordTimer() once, instead of copy-pasting code.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please also update the metrics used in history/taskProcessor.go
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
What changed?
Right now when metrics is emitted with domain tag, our current dashboard and alerts will look at the metrics (p99/mean) only for the one domain due to maxSeries. So, in order to solve this problem, I introduced emitting both domainTagged metrics and operation metrics separately with different metics name. This change is only made for new task processing.
Why?
How did you test it?
Haven't tested it yet.
Potential risks
No risk.