Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add span decoder for bytes slices #883

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

VianneyRuhlmann
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Feb 14, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-14 14:37:44

Comparing candidate commit 84f8853 in PR branch vianney/decode-with-ref with baseline commit 4c831d1 in branch main.

Found 1 performance improvements and 45 performance regressions! Performance is the same for 6 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+25.222ms; +25.288ms] or [+47.250%; +47.375%]

scenario:benching string interning on wordpress profile

  • 🟩 execution_time [-11.712µs; -11.546µs] or [-7.771%; -7.660%]

scenario:concentrator/add_spans_to_concentrator

  • 🟥 execution_time [+366.595µs; +370.445µs] or [+6.184%; +6.249%]

scenario:credit_card/is_card_number/

  • 🟥 execution_time [+375.148ns; +376.353ns] or [+9.584%; +9.615%]
  • 🟥 throughput [-22413526.671op/s; -22341039.434op/s] or [-8.773%; -8.745%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+6.847µs; +7.065µs] or [+8.223%; +8.484%]
  • 🟥 throughput [-941455.822op/s; -911472.562op/s] or [-7.839%; -7.590%]

scenario:credit_card/is_card_number/37828224631

  • 🟥 execution_time [+376.375ns; +377.487ns] or [+9.617%; +9.646%]
  • 🟥 throughput [-22481752.636op/s; -22414237.126op/s] or [-8.798%; -8.772%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+8.031µs; +8.043µs] or [+15.613%; +15.637%]
  • 🟥 throughput [-2629252.987op/s; -2625216.779op/s] or [-13.524%; -13.503%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+1.209µs; +1.210µs] or [+20.019%; +20.043%]
  • 🟥 throughput [-27658845.343op/s; -27625478.971op/s] or [-16.698%; -16.678%]

scenario:credit_card/is_card_number_no_luhn/

  • 🟥 execution_time [+375.151ns; +376.258ns] or [+9.586%; +9.614%]
  • 🟥 throughput [-22413871.799op/s; -22348162.569op/s] or [-8.772%; -8.746%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟥 execution_time [+5.319µs; +5.364µs] or [+8.038%; +8.105%]
  • 🟥 throughput [-1133690.518op/s; -1123660.019op/s] or [-7.502%; -7.436%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.207µs; +4.234µs] or [+7.048%; +7.094%]
  • 🟥 throughput [-1110337.957op/s; -1102835.964op/s] or [-6.627%; -6.582%]

scenario:credit_card/is_card_number_no_luhn/37828224631

  • 🟥 execution_time [+375.202ns; +376.313ns] or [+9.587%; +9.615%]
  • 🟥 throughput [-22415730.651op/s; -22348500.585op/s] or [-8.773%; -8.747%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+3.780µs; +3.830µs] or [+6.646%; +6.734%]
  • 🟥 throughput [-1110242.738op/s; -1094870.802op/s] or [-6.315%; -6.228%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+8.034µs; +8.048µs] or [+15.618%; +15.645%]
  • 🟥 throughput [-2630209.006op/s; -2625734.676op/s] or [-13.530%; -13.507%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+1.208µs; +1.210µs] or [+20.007%; +20.035%]
  • 🟥 throughput [-27645119.468op/s; -27606441.454op/s] or [-16.693%; -16.669%]

scenario:ip_address/quantize_peer_ip_address_benchmark

  • 🟥 execution_time [+343.248ns; +360.821ns] or [+6.668%; +7.010%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟥 execution_time [+103.178µs; +103.523µs] or [+49.313%; +49.478%]
  • 🟥 throughput [-1582302.343op/s; -1578155.802op/s] or [-33.106%; -33.020%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟥 execution_time [+9.997µs; +10.039µs] or [+54.497%; +54.724%]
  • 🟥 throughput [-19304203.978op/s; -19208307.795op/s] or [-35.411%; -35.235%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟥 execution_time [+6.172µs; +6.202µs] or [+57.658%; +57.940%]
  • 🟥 throughput [-34278234.097op/s; -34155991.266op/s] or [-36.692%; -36.561%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟥 execution_time [+114.762µs; +115.066µs] or [+22.695%; +22.755%]
  • 🟥 throughput [-366701.444op/s; -365680.149op/s] or [-18.543%; -18.491%]

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

  • 🟥 execution_time [+26.821µs; +26.939µs] or [+5.917%; +5.943%]
  • 🟥 throughput [-123770.311op/s; -123229.710op/s] or [-5.610%; -5.586%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟥 execution_time [+14.752µs; +14.881µs] or [+8.382%; +8.455%]
  • 🟥 throughput [-443195.971op/s; -439173.866op/s] or [-7.800%; -7.730%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟥 execution_time [+7.840µs; +7.868µs] or [+20.795%; +20.869%]
  • 🟥 throughput [-4580237.123op/s; -4565376.813op/s] or [-17.268%; -17.212%]

scenario:normalization/normalize_trace/test_trace

  • 🟥 execution_time [+51.577ns; +57.033ns] or [+20.242%; +22.384%]

scenario:redis/obfuscate_redis_string

  • 🟥 execution_time [+5.345µs; +5.826µs] or [+15.785%; +17.208%]

scenario:sql/obfuscate_sql_string

  • 🟥 execution_time [+11.285µs; +11.369µs] or [+16.844%; +16.969%]

scenario:tags/replace_trace_tags

  • 🟥 execution_time [+316.851ns; +324.607ns] or [+13.035%; +13.354%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 78.081µs 78.327µs ± 0.214µs 78.306µs ± 0.055µs 78.364µs 78.447µs 78.562µs 80.589µs 2.92% 7.968 75.510 0.27% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [78.297µs; 78.356µs] or [-0.038%; +0.038%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.413µs 5.499µs ± 0.045µs 5.488µs ± 0.029µs 5.547µs 5.571µs 5.576µs 5.585µs 1.75% 0.310 -1.130 0.82% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.493µs; 5.506µs] or [-0.114%; +0.114%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.522µs 28.162µs ± 14.172µs 18.917µs ± 0.294µs 37.227µs 46.182µs 58.814µs 145.506µs 669.18% 3.721 25.083 50.20% 1.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [26.198µs; 30.126µs] or [-6.974%; +6.974%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 309.831µs 312.581µs ± 1.183µs 312.518µs ± 0.810µs 313.341µs 314.464µs 315.551µs 317.363µs 1.55% 0.350 0.849 0.38% 0.084µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3150970.511op/s 3199220.996op/s ± 12091.581op/s 3199817.465op/s ± 8273.386op/s 3207437.011op/s 3216167.260op/s 3226527.682op/s 3227565.595op/s 0.87% -0.319 0.788 0.38% 855.004op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 28.106µs 28.363µs ± 0.092µs 28.360µs ± 0.061µs 28.421µs 28.526µs 28.577µs 28.596µs 0.83% -0.015 0.274 0.32% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 34970123.858op/s 35258159.058op/s ± 114137.527op/s 35260593.420op/s ± 75844.698op/s 35334410.825op/s 35432463.915op/s 35551122.915op/s 35579097.246op/s 0.90% 0.038 0.280 0.32% 8070.742op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.628µs 16.891µs ± 0.105µs 16.895µs ± 0.073µs 16.962µs 17.069µs 17.086µs 17.114µs 1.30% -0.162 -0.501 0.62% 0.007µs 1 200
normalization/normalize_name/normalize_name/good throughput 58430000.614op/s 59205596.122op/s ± 369707.904op/s 59188019.952op/s ± 256932.403op/s 59468318.298op/s 59831216.662op/s 60089405.279op/s 60140192.348op/s 1.61% 0.190 -0.488 0.62% 26142.297op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [312.417µs; 312.744µs] or [-0.052%; +0.052%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3197545.219op/s; 3200896.773op/s] or [-0.052%; +0.052%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [28.350µs; 28.375µs] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35242340.694op/s; 35273977.421op/s] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.876µs; 16.906µs] or [-0.086%; +0.086%] None None None
normalization/normalize_name/normalize_name/good throughput [59154358.162op/s; 59256834.082op/s] or [-0.087%; +0.087%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.273µs 4.290µs ± 0.003µs 4.290µs ± 0.002µs 4.292µs 4.294µs 4.296µs 4.308µs 0.43% 0.221 9.195 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 232121101.122op/s 233103630.775op/s ± 165946.991op/s 233113584.802op/s ± 84546.536op/s 233185513.362op/s 233362508.984op/s 233491687.165op/s 234000703.608op/s 0.38% -0.197 9.164 0.07% 11734.224op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 89.858µs 90.232µs ± 0.343µs 90.194µs ± 0.089µs 90.294µs 90.492µs 90.625µs 94.610µs 4.90% 10.536 131.893 0.38% 0.024µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10569746.472op/s 11082708.869op/s ± 40473.699op/s 11087218.111op/s ± 10925.725op/s 11097225.971op/s 11110797.251op/s 11115606.635op/s 11128728.813op/s 0.37% -10.276 127.433 0.36% 2861.923op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 82.206µs 82.576µs ± 0.353µs 82.572µs ± 0.073µs 82.628µs 82.722µs 82.824µs 87.297µs 5.72% 12.051 159.125 0.43% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11455149.539op/s 12110233.204op/s ± 49219.334op/s 12110584.045op/s ± 10629.420op/s 12125432.489op/s 12141421.251op/s 12151283.117op/s 12164531.624op/s 0.45% -11.845 155.516 0.41% 3480.332op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.274µs 4.291µs ± 0.003µs 4.290µs ± 0.001µs 4.292µs 4.294µs 4.296µs 4.299µs 0.21% -1.196 7.960 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 232598633.645op/s 233071938.965op/s ± 145128.824op/s 233078032.410op/s ± 72294.880op/s 233145749.030op/s 233228601.085op/s 233453471.533op/s 233976828.164op/s 0.39% 1.212 8.048 0.06% 10262.158op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 78.954µs 79.355µs ± 0.192µs 79.318µs ± 0.108µs 79.447µs 79.722µs 79.909µs 80.143µs 1.04% 0.973 1.443 0.24% 0.014µs 1 200
credit_card/is_card_number/378282246310005 throughput 12477739.366op/s 12601684.724op/s ± 30468.643op/s 12607552.571op/s ± 17244.425op/s 12622379.485op/s 12640906.038op/s 12657054.410op/s 12665637.131op/s 0.46% -0.955 1.386 0.24% 2154.458op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 59.371µs 59.474µs ± 0.036µs 59.473µs ± 0.021µs 59.492µs 59.537µs 59.556µs 59.567µs 0.16% 0.113 0.121 0.06% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16787883.797op/s 16814134.627op/s ± 10059.038op/s 16814462.308op/s ± 5912.174op/s 16820489.546op/s 16830259.109op/s 16837696.281op/s 16843229.894op/s 0.17% -0.109 0.122 0.06% 711.281op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 7.237µs 7.247µs ± 0.004µs 7.247µs ± 0.002µs 7.248µs 7.252µs 7.257µs 7.277µs 0.42% 2.048 14.029 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 137417925.153op/s 137996187.949op/s ± 78295.112op/s 137995556.544op/s ± 40608.932op/s 138039852.108op/s 138109498.759op/s 138163588.176op/s 138178028.572op/s 0.13% -2.028 13.856 0.06% 5536.300op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.273µs 4.289µs ± 0.003µs 4.289µs ± 0.002µs 4.291µs 4.294µs 4.295µs 4.304µs 0.34% -0.126 6.276 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232357131.016op/s 233137232.691op/s ± 164025.925op/s 233138386.236op/s ± 86963.274op/s 233216427.472op/s 233386301.979op/s 233446976.917op/s 234031069.206op/s 0.38% 0.144 6.298 0.07% 11598.384op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 71.417µs 71.519µs ± 0.042µs 71.518µs ± 0.022µs 71.540µs 71.577µs 71.623µs 71.736µs 0.30% 1.064 5.287 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13940099.393op/s 13982276.255op/s ± 8123.625op/s 13982562.347op/s ± 4322.249op/s 13986739.871op/s 13995701.785op/s 13999388.201op/s 14002215.150op/s 0.14% -1.053 5.239 0.06% 574.427op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 63.824µs 63.903µs ± 0.040µs 63.895µs ± 0.022µs 63.926µs 63.974µs 63.990µs 64.105µs 0.33% 1.004 2.417 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15599325.076op/s 15648735.054op/s ± 9800.548op/s 15650773.622op/s ± 5334.479op/s 15655266.251op/s 15661331.469op/s 15666694.034op/s 15668187.312op/s 0.11% -0.997 2.387 0.06% 693.003op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.274µs 4.290µs ± 0.003µs 4.290µs ± 0.001µs 4.291µs 4.293µs 4.295µs 4.309µs 0.45% 0.778 17.250 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232071528.607op/s 233125244.890op/s ± 147314.297op/s 233125737.082op/s ± 50979.077op/s 233174738.334op/s 233328618.901op/s 233442798.169op/s 233970252.354op/s 0.36% -0.743 17.130 0.06% 10416.694op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 60.571µs 60.686µs ± 0.038µs 60.680µs ± 0.018µs 60.702µs 60.741µs 60.778µs 61.010µs 0.54% 3.127 25.022 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16390683.972op/s 16478375.203op/s ± 10370.078op/s 16479846.796op/s ± 4862.229op/s 16484177.250op/s 16489264.417op/s 16502211.679op/s 16509673.017op/s 0.18% -3.095 24.694 0.06% 733.275op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 59.379µs 59.481µs ± 0.038µs 59.475µs ± 0.023µs 59.502µs 59.545µs 59.573µs 59.701µs 0.38% 1.119 5.106 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16750209.576op/s 16812067.106op/s ± 10674.897op/s 16813798.179op/s ± 6574.949op/s 16819258.728op/s 16825541.511op/s 16834676.677op/s 16840870.021op/s 0.16% -1.108 5.045 0.06% 754.829op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 7.235µs 7.247µs ± 0.005µs 7.247µs ± 0.002µs 7.250µs 7.254µs 7.258µs 7.275µs 0.39% 0.996 5.904 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 137451034.314op/s 137985362.254op/s ± 88986.498op/s 137991320.348op/s ± 47523.784op/s 138034132.390op/s 138126914.475op/s 138185368.549op/s 138224282.721op/s 0.17% -0.982 5.829 0.06% 6292.296op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.290µs; 4.290µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [233080632.119op/s; 233126629.432op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.184µs; 90.279µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11077099.604op/s; 11088318.134op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.527µs; 82.625µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12103411.877op/s; 12117054.530op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/37828224631 execution_time [4.290µs; 4.291µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [233051825.506op/s; 233092052.425op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [79.328µs; 79.382µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number/378282246310005 throughput [12597462.063op/s; 12605907.385op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [59.469µs; 59.479µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16812740.541op/s; 16815528.713op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [7.246µs; 7.247µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 throughput [137985337.000op/s; 138007038.899op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.289µs; 4.290µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [233114500.275op/s; 233159965.107op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [71.513µs; 71.525µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13981150.399op/s; 13983402.112op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [63.897µs; 63.909µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15647376.792op/s; 15650093.315op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.289µs; 4.290µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233104828.546op/s; 233145661.235op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [60.680µs; 60.691µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16476938.010op/s; 16479812.396op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [59.476µs; 59.486µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16810587.668op/s; 16813546.544op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [7.247µs; 7.248µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [137973029.581op/s; 137997694.926op/s] or [-0.009%; +0.009%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.039µs 139.094µs ± 0.351µs 139.075µs ± 0.210µs 139.298µs 139.602µs 140.200µs 140.872µs 1.29% 0.759 3.530 0.25% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.046µs; 139.143µs] or [-0.035%; +0.035%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 619.186µs 620.584µs ± 0.727µs 620.543µs ± 0.319µs 620.886µs 621.375µs 621.862µs 628.001µs 1.20% 5.301 52.380 0.12% 0.051µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1592353.645op/s 1611386.873op/s ± 1876.423op/s 1611491.784op/s ± 829.538op/s 1612293.285op/s 1613593.497op/s 1614322.647op/s 1615023.769op/s 0.22% -5.210 51.176 0.12% 132.683op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 479.345µs 480.166µs ± 0.323µs 480.196µs ± 0.229µs 480.392µs 480.689µs 480.883µs 480.949µs 0.16% -0.110 -0.376 0.07% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2079221.399op/s 2082612.134op/s ± 1402.859op/s 2082481.274op/s ± 993.321op/s 2083579.445op/s 2084921.635op/s 2085873.385op/s 2086178.497op/s 0.18% 0.113 -0.375 0.07% 99.197op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.313µs 190.818µs ± 0.232µs 190.797µs ± 0.158µs 190.965µs 191.268µs 191.360µs 191.456µs 0.35% 0.371 -0.207 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5223120.316op/s 5240599.530op/s ± 6374.789op/s 5241163.046op/s ± 4352.291op/s 5245464.010op/s 5249304.548op/s 5253529.020op/s 5254493.299op/s 0.25% -0.365 -0.212 0.12% 450.766op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.338µs 45.556µs ± 0.089µs 45.557µs ± 0.058µs 45.612µs 45.701µs 45.776µs 45.819µs 0.57% 0.125 0.316 0.20% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21825112.215op/s 21950962.665op/s ± 42996.549op/s 21950422.171op/s ± 27877.031op/s 21979963.444op/s 22022137.210op/s 22050857.724op/s 22056579.843op/s 0.48% -0.112 0.308 0.20% 3040.315op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 47.355µs 47.501µs ± 0.050µs 47.501µs ± 0.031µs 47.533µs 47.583µs 47.609µs 47.755µs 0.54% 0.581 2.972 0.10% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20940021.354op/s 21052311.418op/s ± 22087.496op/s 21052072.546op/s ± 13613.080op/s 21065307.300op/s 21084411.037op/s 21101955.691op/s 21117048.681op/s 0.31% -0.566 2.918 0.10% 1561.822op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [620.484µs; 620.685µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1611126.819op/s; 1611646.927op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [480.122µs; 480.211µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2082417.711op/s; 2082806.557op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.786µs; 190.850µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5239716.046op/s; 5241483.014op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.544µs; 45.569µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21945003.757op/s; 21956921.573op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [47.494µs; 47.508µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21049250.303op/s; 21055372.532op/s] or [-0.015%; +0.015%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.771µs 39.443µs ± 1.223µs 38.878µs ± 0.046µs 38.943µs 42.091µs 42.108µs 42.433µs 9.14% 1.693 0.901 3.09% 0.087µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.273µs; 39.612µs] or [-0.430%; +0.430%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.422µs 3.359µs ± 1.511µs 3.159µs ± 0.028µs 3.185µs 3.814µs 14.648µs 15.753µs 398.73% 7.453 56.265 44.87% 0.107µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.150µs; 3.569µs] or [-6.234%; +6.234%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 297.004ns 309.102ns ± 15.667ns 302.587ns ± 3.716ns 308.593ns 342.709ns 365.196ns 367.699ns 21.52% 2.070 3.665 5.06% 1.108ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [306.930ns; 311.273ns] or [-0.702%; +0.702%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.712µs 2.752µs ± 0.017µs 2.749µs ± 0.008µs 2.757µs 2.790µs 2.803µs 2.806µs 2.08% 1.070 1.606 0.62% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.749µs; 2.754µs] or [-0.086%; +0.086%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 78.238ms 78.634ms ± 0.184ms 78.609ms ± 0.131ms 78.753ms 78.915ms 79.169ms 79.343ms 0.93% 0.624 0.881 0.23% 0.013ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [78.609ms; 78.660ms] or [-0.032%; +0.032%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 84f8853 1739543125 vianney/decode-with-ref
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.282ms 6.297ms ± 0.011ms 6.295ms ± 0.003ms 6.299ms 6.307ms 6.358ms 6.374ms 1.24% 4.702 27.085 0.17% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.295ms; 6.298ms] or [-0.024%; +0.024%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.72%. Comparing base (5ada426) to head (84f8853).
Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #883      +/-   ##
==========================================
- Coverage   71.90%   71.72%   -0.19%     
==========================================
  Files         324      324              
  Lines       48077    48329     +252     
==========================================
+ Hits        34572    34662      +90     
- Misses      13505    13667     +162     
Components Coverage Δ
crashtracker 42.69% <ø> (-0.54%) ⬇️
crashtracker-ffi 6.25% <ø> (-0.05%) ⬇️
datadog-alloc 98.58% <ø> (-0.15%) ⬇️
data-pipeline 92.01% <100.00%> (-0.35%) ⬇️
data-pipeline-ffi 90.39% <ø> (-1.06%) ⬇️
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 80.04% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.97% <ø> (-0.54%) ⬇️
sidecar-ffi 5.14% <ø> (-4.12%) ⬇️
spawn-worker 54.37% <ø> (ø)
tinybytes 91.21% <100.00%> (-1.58%) ⬇️
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.33% <100.00%> (-0.24%) ⬇️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants