Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use send_with_retry in the trace exporter #871

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

VianneyRuhlmann
Copy link
Contributor

@VianneyRuhlmann VianneyRuhlmann commented Feb 12, 2025

What does this PR do?

Use send_with_retry in trace exporter to remove ownership constraint.

Motivation

Removing ownership constraint is required to remove incorrect lifetime assumption in the trace exporter.

Additional Notes

Some minor refactors were needed:

  • Replace the Serde error type which was not used anymore to support rmp_serde error
  • Move headers used in SendData to ddcommon to be reused in data-pipeline
  • Improve the trace exporter errors in case the sending fails (e.g. returning message from hyper error)
  • Introduce a common representation for telemetry to handle both SendWithRetryResult and SendDataResult

Commits although not atomic separate the changes into areas affected, so reviewing by commit can help by breaking down the changes.

How to test the change?

Describe here in detail how the change can be validated.

@VianneyRuhlmann VianneyRuhlmann requested review from a team as code owners February 12, 2025 15:16
@VianneyRuhlmann VianneyRuhlmann force-pushed the vianney/data-pipeline/use-send-with-retry branch 2 times, most recently from f71e4f1 to d085821 Compare February 12, 2025 15:25
@VianneyRuhlmann VianneyRuhlmann force-pushed the vianney/data-pipeline/use-send-with-retry branch from d085821 to e8d1c90 Compare February 12, 2025 15:27
@pr-commenter
Copy link

pr-commenter bot commented Feb 12, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-14 13:13:59

Comparing candidate commit 3b5fba7 in PR branch vianney/data-pipeline/use-send-with-retry with baseline commit 7a481f8 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.086µs 33.662µs ± 0.968µs 33.212µs ± 0.061µs 33.347µs 35.722µs 35.792µs 36.775µs 10.73% 1.700 1.027 2.87% 0.068µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.528µs; 33.796µs] or [-0.399%; +0.399%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.270µs 3.175µs ± 1.482µs 2.975µs ± 0.024µs 3.005µs 3.577µs 13.815µs 16.397µs 451.11% 7.557 58.349 46.54% 0.105µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.970µs; 3.381µs] or [-6.467%; +6.467%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.085µs 26.151µs ± 10.960µs 18.384µs ± 0.199µs 34.580µs 41.668µs 57.477µs 97.418µs 429.91% 2.130 9.025 41.81% 0.775µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.632µs; 27.670µs] or [-5.809%; +5.809%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.052µs 5.107µs ± 0.047µs 5.080µs ± 0.022µs 5.141µs 5.196µs 5.199µs 5.233µs 3.02% 0.798 -0.767 0.91% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.100µs; 5.113µs] or [-0.127%; +0.127%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.714µs 209.140µs ± 0.155µs 209.124µs ± 0.082µs 209.210µs 209.419µs 209.555µs 209.804µs 0.33% 0.534 1.665 0.07% 0.011µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4766357.776op/s 4781497.078op/s ± 3533.619op/s 4781862.396op/s ± 1878.839op/s 4783569.396op/s 4786677.847op/s 4790559.666op/s 4791247.349op/s 0.20% -0.527 1.650 0.07% 249.865op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.256µs 18.347µs ± 0.057µs 18.344µs ± 0.022µs 18.366µs 18.395µs 18.417µs 19.012µs 3.65% 7.828 89.479 0.31% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52597568.490op/s 54506160.125op/s ± 166138.030op/s 54514973.639op/s ± 64382.461op/s 54572017.400op/s 54685508.357op/s 54730801.474op/s 54776057.983op/s 0.48% -7.549 85.286 0.30% 11747.733op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.663µs 10.734µs ± 0.034µs 10.733µs ± 0.020µs 10.752µs 10.776µs 10.788µs 11.038µs 2.84% 3.383 29.004 0.32% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 90598647.989op/s 93160224.811op/s ± 294158.585op/s 93169994.391op/s ± 171227.569op/s 93350081.377op/s 93542232.972op/s 93692018.379op/s 93781155.182op/s 0.66% -3.201 26.992 0.31% 20800.153op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.118µs; 209.161µs] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4781007.352op/s; 4781986.803op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.339µs; 18.355µs] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54483134.992op/s; 54529185.258op/s] or [-0.042%; +0.042%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.730µs; 10.739µs] or [-0.044%; +0.044%] None None None
normalization/normalize_name/normalize_name/good throughput [93119457.261op/s; 93200992.362op/s] or [-0.044%; +0.044%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 150.530µs 151.141µs ± 0.356µs 151.084µs ± 0.152µs 151.248µs 151.698µs 152.873µs 153.092µs 1.33% 2.559 10.151 0.24% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [151.092µs; 151.190µs] or [-0.033%; +0.033%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.198µs 505.720µs ± 0.381µs 505.717µs ± 0.209µs 505.924µs 506.324µs 506.761µs 506.999µs 0.25% -0.097 1.820 0.08% 0.027µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1972389.614op/s 1977380.194op/s ± 1489.045op/s 1977388.779op/s ± 816.775op/s 1978215.126op/s 1979656.097op/s 1981265.175op/s 1983346.938op/s 0.30% 0.106 1.826 0.08% 105.291op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.774µs 453.595µs ± 0.328µs 453.598µs ± 0.197µs 453.798µs 454.127µs 454.272µs 454.907µs 0.29% 0.028 0.852 0.07% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2198252.477op/s 2204612.841op/s ± 1594.758op/s 2204593.193op/s ± 955.644op/s 2205535.204op/s 2207513.438op/s 2208355.604op/s 2208606.165op/s 0.18% -0.022 0.843 0.07% 112.766op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 174.882µs 176.293µs ± 0.353µs 176.320µs ± 0.217µs 176.524µs 176.801µs 176.916µs 177.071µs 0.43% -0.835 1.516 0.20% 0.025µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5647445.929op/s 5672384.687op/s ± 11381.631op/s 5671517.728op/s ± 6978.586op/s 5678922.058op/s 5691715.012op/s 5708294.624op/s 5718134.995op/s 0.82% 0.852 1.564 0.20% 804.803op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.603µs 37.695µs ± 0.045µs 37.693µs ± 0.032µs 37.727µs 37.771µs 37.797µs 37.819µs 0.34% 0.267 -0.450 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26441650.273op/s 26528855.403op/s ± 31412.839op/s 26530415.502op/s ± 22464.234op/s 26549998.991op/s 26575872.978op/s 26585191.393op/s 26593705.084op/s 0.24% -0.262 -0.455 0.12% 2221.223op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.244µs 48.319µs ± 0.042µs 48.308µs ± 0.020µs 48.337µs 48.399µs 48.454µs 48.488µs 0.37% 1.305 2.203 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20623736.796op/s 20695859.336op/s ± 17869.177op/s 20700570.830op/s ± 8774.749op/s 20707636.412op/s 20718729.916op/s 20725794.087op/s 20727795.290op/s 0.13% -1.299 2.179 0.09% 1263.542op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.667µs; 505.773µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977173.827op/s; 1977586.562op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.549µs; 453.640µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2204391.823op/s; 2204833.859op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.244µs; 176.342µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5670807.302op/s; 5673962.071op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.689µs; 37.701µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26524501.886op/s; 26533208.920op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.313µs; 48.325µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20693382.840op/s; 20698335.832op/s] or [-0.012%; +0.012%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.914µs ± 0.006µs 3.914µs ± 0.002µs 3.915µs 3.917µs 3.921µs 3.969µs 1.41% 6.752 59.501 0.15% 0.000µs 1 200
credit_card/is_card_number/ throughput 251968677.809op/s 255515123.831op/s ± 391371.686op/s 255523943.299op/s ± 102661.570op/s 255644565.239op/s 255827602.283op/s 255942408.418op/s 256788597.381op/s 0.49% -6.678 58.765 0.15% 27674.157op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.623µs 83.288µs ± 0.725µs 83.287µs ± 0.423µs 83.702µs 84.367µs 84.653µs 87.916µs 5.56% 1.236 7.090 0.87% 0.051µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11374457.178op/s 12007477.321op/s ± 103498.304op/s 12006718.363op/s ± 61221.592op/s 12068789.450op/s 12168132.502op/s 12223929.106op/s 12251408.708op/s 2.04% -1.051 5.849 0.86% 7318.435op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 78.483µs 79.619µs ± 0.516µs 79.625µs ± 0.265µs 79.890µs 80.263µs 80.405µs 84.032µs 5.54% 2.911 25.185 0.65% 0.036µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11900168.270op/s 12560269.796op/s ± 79997.852op/s 12558902.001op/s ± 41778.804op/s 12600624.858op/s 12675798.407op/s 12730654.981op/s 12741537.412op/s 1.45% -2.567 21.704 0.64% 5656.702op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.918µs 3.919µs 0.13% -3.141 23.769 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255183234.741op/s 255519420.811op/s ± 170173.300op/s 255505667.314op/s ± 87146.544op/s 255593386.522op/s 255722680.412op/s 255956960.931op/s 256953192.598op/s 0.57% 3.173 24.105 0.07% 12033.069op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 74.876µs 76.289µs ± 0.430µs 76.338µs ± 0.284µs 76.595µs 76.929µs 77.068µs 77.289µs 1.25% -0.532 0.295 0.56% 0.030µs 1 200
credit_card/is_card_number/378282246310005 throughput 12938459.394op/s 13108401.081op/s ± 74036.080op/s 13099622.267op/s ± 48643.003op/s 13155407.154op/s 13234330.650op/s 13299285.098op/s 13355384.557op/s 1.95% 0.566 0.355 0.56% 5235.141op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.342µs 51.439µs ± 0.033µs 51.438µs ± 0.022µs 51.462µs 51.491µs 51.505µs 51.518µs 0.16% -0.324 0.272 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19410859.510op/s 19440327.142op/s ± 12600.630op/s 19441010.143op/s ± 8324.565op/s 19447663.909op/s 19462482.563op/s 19475528.453op/s 19477057.973op/s 0.19% 0.328 0.277 0.06% 890.999op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.024µs 6.038µs ± 0.006µs 6.038µs ± 0.002µs 6.040µs 6.044µs 6.047µs 6.107µs 1.15% 5.984 64.003 0.11% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163744999.330op/s 165627666.658op/s ± 176797.535op/s 165625336.099op/s ± 67373.423op/s 165702564.252op/s 165854186.384op/s 165955481.035op/s 165991281.501op/s 0.22% -5.888 62.714 0.11% 12501.474op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.918µs 3.919µs 3.920µs 0.17% -1.517 8.902 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255091271.477op/s 255518703.167op/s ± 182749.596op/s 255513317.107op/s ± 100995.951op/s 255612691.175op/s 255789798.648op/s 255958430.738op/s 256738120.086op/s 0.48% 1.536 9.037 0.07% 12922.348op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.855µs 66.221µs ± 0.257µs 66.159µs ± 0.130µs 66.308µs 66.654µs 67.192µs 67.408µs 1.89% 1.747 4.133 0.39% 0.018µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14835034.417op/s 15101152.732op/s ± 58136.143op/s 15115025.121op/s ± 29673.752op/s 15138938.865op/s 15165235.840op/s 15182859.486op/s 15184918.620op/s 0.46% -1.712 3.964 0.38% 4110.846op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.467µs 59.693µs ± 0.097µs 59.696µs ± 0.072µs 59.765µs 59.839µs 59.879µs 59.930µs 0.39% -0.265 -0.480 0.16% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16686188.514op/s 16752397.779op/s ± 27242.821op/s 16751511.917op/s ± 20166.341op/s 16772126.403op/s 16800847.022op/s 16811523.193op/s 16815928.047op/s 0.38% 0.272 -0.477 0.16% 1926.358op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.919µs 3.921µs 3.924µs 0.25% -0.509 3.013 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254870865.428op/s 255520746.407op/s ± 206773.291op/s 255518387.428op/s ± 116709.332op/s 255626489.297op/s 255828982.621op/s 255922717.309op/s 256596878.874op/s 0.42% 0.521 3.057 0.08% 14621.080op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.357µs 56.848µs ± 0.200µs 56.867µs ± 0.148µs 57.015µs 57.143µs 57.199µs 57.218µs 0.62% -0.342 -0.554 0.35% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17477140.942op/s 17591062.747op/s ± 61959.188op/s 17585006.145op/s ± 45793.983op/s 17630723.741op/s 17697234.956op/s 17733290.364op/s 17744096.257op/s 0.90% 0.356 -0.539 0.35% 4381.176op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.360µs 51.438µs ± 0.027µs 51.437µs ± 0.014µs 51.451µs 51.479µs 51.504µs 51.583µs 0.28% 0.746 4.048 0.05% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19386378.375op/s 19440838.635op/s ± 10381.189op/s 19441421.054op/s ± 5165.576op/s 19446268.017op/s 19457695.080op/s 19466783.322op/s 19470373.879op/s 0.15% -0.737 4.015 0.05% 734.061op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.039µs ± 0.008µs 6.038µs ± 0.002µs 6.040µs 6.044µs 6.058µs 6.110µs 1.20% 7.279 62.319 0.13% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163658028.885op/s 165597639.443op/s ± 215753.628op/s 165625138.074op/s ± 51415.816op/s 165670404.440op/s 165753258.578op/s 165827462.323op/s 165875292.850op/s 0.15% -7.234 61.785 0.13% 15256.085op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.915µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/ throughput [255460883.479op/s; 255569364.183op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [83.187µs; 83.388µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11993133.451op/s; 12021821.191op/s] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [79.548µs; 79.691µs] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12549182.863op/s; 12571356.729op/s] or [-0.088%; +0.088%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255495836.428op/s; 255543005.193op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.230µs; 76.349µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/378282246310005 throughput [13098140.393op/s; 13118661.770op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.435µs; 51.444µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19438580.816op/s; 19442073.469op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/x371413321323331 throughput [165603164.220op/s; 165652169.096op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255493375.830op/s; 255544030.503op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.186µs; 66.257µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15093095.622op/s; 15109209.842op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.680µs; 59.707µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16748622.186op/s; 16756173.372op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255492089.618op/s; 255549403.197op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.820µs; 56.875µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17582475.799op/s; 17599649.694op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.434µs; 51.442µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19439399.902op/s; 19442277.368op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.038µs; 6.040µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165567738.065op/s; 165627540.821op/s] or [-0.018%; +0.018%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.734ms 54.955ms ± 0.177ms 54.914ms ± 0.051ms 54.978ms 55.280ms 55.722ms 55.769ms 1.56% 2.619 7.686 0.32% 0.012ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.931ms; 54.980ms] or [-0.045%; +0.045%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.345µs 2.400µs ± 0.018µs 2.396µs ± 0.008µs 2.413µs 2.430µs 2.438µs 2.440µs 1.83% -0.015 0.246 0.73% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.397µs; 2.402µs] or [-0.102%; +0.102%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.918ms 5.930ms ± 0.011ms 5.929ms ± 0.003ms 5.932ms 5.938ms 5.987ms 6.024ms 1.61% 5.673 40.264 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.929ms; 5.932ms] or [-0.025%; +0.025%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.459ns 252.473ns ± 11.538ns 248.346ns ± 2.568ns 252.043ns 276.786ns 297.238ns 299.429ns 20.57% 2.555 6.109 4.56% 0.816ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.874ns; 254.072ns] or [-0.633%; +0.633%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3b5fba7 1739538156 vianney/data-pipeline/use-send-with-retry
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.444µs 66.723µs ± 0.219µs 66.706µs ± 0.053µs 66.758µs 66.855µs 67.035µs 69.297µs 3.89% 8.942 98.222 0.33% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.692µs; 66.753µs] or [-0.045%; +0.045%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Feb 12, 2025

Codecov Report

Attention: Patch coverage is 86.11111% with 30 lines in your changes missing coverage. Please review.

Project coverage is 71.66%. Comparing base (7a481f8) to head (3b5fba7).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #871      +/-   ##
==========================================
- Coverage   71.66%   71.66%   -0.01%     
==========================================
  Files         324      324              
  Lines       48248    48299      +51     
==========================================
+ Hits        34576    34612      +36     
- Misses      13672    13687      +15     
Components Coverage Δ
crashtracker 42.71% <ø> (-0.03%) ⬇️
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.64% <86.08%> (-0.38%) ⬇️
data-pipeline-ffi 90.39% <0.00%> (ø)
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 80.04% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.97% <ø> (ø)
sidecar-ffi 5.14% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 92.79% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.22% <86.36%> (+<0.01%) ⬆️

let endpoint = Endpoint {
url: self.output_format.add_path(&self.endpoint.url),
..self.endpoint.clone()
};
let send_data = SendData::new(size, tracer_payload, header_tags, &endpoint);
let mut headers: HashMap<&str, String> = header_tags.into();
headers.insert(DATADOG_SEND_REAL_HTTP_STATUS_STR, "1".to_string());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❓ what does 1 mean here?

let send_data_result = send_data.send().await;
// Send traces to the agent
let result =
send_with_retry(&endpoint, payload, &headers, &strategy, None).await;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❓ are we capturing telemetry like

  • max retry count
  • retry attempt
  • last failure reason?

@VianneyRuhlmann VianneyRuhlmann changed the title Return hyper error in send_with_retry Use send_with_retry in the trace exporter Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants