Skip to content

ci: changed-crates binary install#1692

Draft
iunanua wants to merge 3 commits intojulio/rd-week-dynamic-pipelinefrom
igor/rd-week-dynamic-pipeline-refactor-binstall
Draft

ci: changed-crates binary install#1692
iunanua wants to merge 3 commits intojulio/rd-week-dynamic-pipelinefrom
igor/rd-week-dynamic-pipeline-refactor-binstall

Conversation

@iunanua
Copy link
Contributor

@iunanua iunanua commented Mar 9, 2026

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@iunanua iunanua changed the title use changed crates release ci: changed-crates binary install Mar 9, 2026
@codecov-commenter
Copy link

codecov-commenter commented Mar 9, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.19%. Comparing base (5a74902) to head (bc602f0).

Additional details and impacted files 
@@                           Coverage Diff                           @@
##           igor/rd-week-dynamic-pipeline-refactor    #1692   +/-   ##
=======================================================================
  Coverage                                   71.19%   71.19%           
=======================================================================
  Files                                         423      423           
  Lines                                       62453    62453           
=======================================================================
+ Hits                                        44461    44463    +2     
+ Misses                                      17992    17990    -2
Components Coverage Δ
libdd-crashtracker 63.23% <ø> (+0.04%) ⬆️
libdd-crashtracker-ffi 17.64% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.70% <ø> (ø)
libdd-data-pipeline-ffi 73.91% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.74% <ø> (ø)
libdd-profiling 81.55% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 33.46% <ø> (ø)
datdog-sidecar-ffi 12.49% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.21% <ø> (ø)
libdd-trace-protobuf 68.00% <ø> (ø)
libdd-trace-utils 89.18% <ø> (ø)
datadog-tracer-flare 88.95% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 9, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-09 10:26:36

Comparing candidate commit bc602f0 in PR branch igor/rd-week-dynamic-pipeline-refactor-binstall with baseline commit 5a74902 in branch igor/rd-week-dynamic-pipeline-refactor.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 716.499µs 718.343µs ± 0.894µs 718.266µs ± 0.562µs 718.865µs 719.860µs 720.861µs 722.662µs 0.61% 0.943 2.237 0.12% 0.063µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [718.219µs; 718.467µs] or [-0.017%; +0.017%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.893ns 251.108ns ± 14.201ns 244.925ns ± 3.054ns 251.809ns 289.407ns 296.979ns 298.243ns 21.77% 1.967 2.987 5.64% 1.004ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [249.140ns; 253.076ns] or [-0.784%; +0.784%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.943µs 5.024µs ± 0.046µs 5.024µs ± 0.042µs 5.049µs 5.096µs 5.098µs 5.099µs 1.50% 0.067 -1.163 0.90% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.017µs; 5.030µs] or [-0.126%; +0.126%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.107ms 3.134ms ± 0.017ms 3.130ms ± 0.007ms 3.139ms 3.165ms 3.199ms 3.226ms 3.05% 2.439 8.390 0.53% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.132ms; 3.136ms] or [-0.073%; +0.073%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.836µs 25.589µs ± 9.458µs 18.067µs ± 0.170µs 33.709µs 43.167µs 44.030µs 60.364µs 234.11% 0.855 -0.047 36.87% 0.669µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.278µs; 26.900µs] or [-5.122%; +5.122%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.968ns 190.462ns ± 2.565ns 190.071ns ± 1.524ns 191.290ns 195.719ns 200.468ns 201.613ns 6.07% 1.793 3.873 1.34% 0.181ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.106ns; 190.817ns] or [-0.187%; +0.187%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.014µs 534.708µs ± 0.738µs 534.604µs ± 0.223µs 534.874µs 535.281µs 535.872µs 543.786µs 1.72% 9.433 112.890 0.14% 0.052µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1838958.907op/s 1870182.708op/s ± 2547.917op/s 1870543.946op/s ± 780.175op/s 1871213.253op/s 1871982.948op/s 1872484.576op/s 1872610.906op/s 0.11% -9.326 111.111 0.14% 180.165op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.183µs 381.756µs ± 0.302µs 381.706µs ± 0.219µs 381.971µs 382.266µs 382.585µs 382.633µs 0.24% 0.465 -0.012 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2613473.616op/s 2619476.013op/s ± 2069.097op/s 2619816.003op/s ± 1501.336op/s 2620970.540op/s 2622565.035op/s 2623173.367op/s 2623410.057op/s 0.14% -0.461 -0.020 0.08% 146.307op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.927µs 190.440µs ± 0.243µs 190.411µs ± 0.171µs 190.618µs 190.835µs 190.954µs 191.096µs 0.36% 0.190 -0.538 0.13% 0.017µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5232973.279op/s 5251001.079op/s ± 6709.402op/s 5251792.601op/s ± 4721.337op/s 5255344.720op/s 5261935.880op/s 5263587.875op/s 5265181.526op/s 0.25% -0.185 -0.541 0.13% 474.426op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.339µs 37.511µs ± 0.069µs 37.505µs ± 0.045µs 37.556µs 37.627µs 37.699µs 37.747µs 0.65% 0.317 0.522 0.18% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26491841.538op/s 26658647.495op/s ± 48866.481op/s 26663308.361op/s ± 32108.847op/s 26688692.262op/s 26735316.169op/s 26764646.103op/s 26781802.913op/s 0.44% -0.304 0.505 0.18% 3455.382op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.766µs 45.887µs ± 0.054µs 45.878µs ± 0.036µs 45.923µs 45.986µs 46.025µs 46.033µs 0.34% 0.502 -0.082 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21723611.416op/s 21792611.305op/s ± 25713.430op/s 21797162.102op/s ± 16886.652op/s 21810077.499op/s 21830012.265op/s 21837952.473op/s 21850159.971op/s 0.24% -0.496 -0.089 0.12% 1818.214op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.606µs; 534.810µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869829.591op/s; 1870535.825op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.714µs; 381.798µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2619189.256op/s; 2619762.770op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.406µs; 190.474µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5250071.221op/s; 5251930.938op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.502µs; 37.521µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26651875.071op/s; 26665419.919op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.880µs; 45.895µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21789047.671op/s; 21796174.939op/s] or [-0.016%; +0.016%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.638ms 49.969ms ± 1.141ms 49.806ms ± 0.046ms 49.864ms 49.981ms 58.244ms 59.544ms 19.55% 7.833 60.526 2.28% 0.081ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.811ms; 50.127ms] or [-0.316%; +0.316%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.395µs 2.422µs ± 0.011µs 2.420µs ± 0.005µs 2.426µs 2.447µs 2.455µs 2.457µs 1.55% 1.050 1.626 0.44% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.421µs; 2.424µs] or [-0.061%; +0.061%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.489µs 34.870µs ± 0.434µs 34.721µs ± 0.105µs 34.834µs 35.706µs 35.746µs 37.706µs 8.60% 2.386 8.337 1.24% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.810µs; 34.930µs] or [-0.173%; +0.173%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.206µs 3.207µs ± 1.424µs 2.986µs ± 0.031µs 3.013µs 3.649µs 14.079µs 14.657µs 390.82% 7.310 54.690 44.30% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.009µs; 3.404µs] or [-6.154%; +6.154%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.297µs 162.139µs ± 0.325µs 162.104µs ± 0.170µs 162.270µs 162.649µs 163.088µs 164.200µs 1.29% 1.932 9.516 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.094µs; 162.184µs] or [-0.028%; +0.028%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.486µs 185.916µs ± 0.205µs 185.892µs ± 0.149µs 186.053µs 186.276µs 186.405µs 186.477µs 0.31% 0.447 -0.376 0.11% 0.014µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5362580.849op/s 5378767.292op/s ± 5918.567op/s 5379472.354op/s ± 4327.283op/s 5383360.725op/s 5386702.303op/s 5389741.869op/s 5391232.293op/s 0.22% -0.443 -0.381 0.11% 418.506op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.904µs 18.010µs ± 0.049µs 18.013µs ± 0.037µs 18.048µs 18.086µs 18.097µs 18.122µs 0.60% -0.187 -0.808 0.27% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55181163.469op/s 55524305.783op/s ± 151393.542op/s 55514166.232op/s ± 115435.213op/s 55636159.237op/s 55776653.220op/s 55849413.948op/s 55853283.281op/s 0.61% 0.196 -0.805 0.27% 10705.140op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.205µs 10.338µs ± 0.072µs 10.322µs ± 0.051µs 10.396µs 10.467µs 10.492µs 10.564µs 2.34% 0.548 -0.527 0.69% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 94665322.228op/s 96734313.444op/s ± 670356.407op/s 96879314.231op/s ± 480134.707op/s 97269150.201op/s 97643005.784op/s 97821202.499op/s 97992126.481op/s 1.15% -0.523 -0.566 0.69% 47401.356op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.888µs; 185.945µs] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5377947.035op/s; 5379587.548op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.003µs; 18.017µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55503324.095op/s; 55545287.472op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.328µs; 10.348µs] or [-0.096%; +0.096%] None None None
normalization/normalize_name/normalize_name/good throughput [96641408.493op/s; 96827218.395op/s] or [-0.096%; +0.096%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.919µs 0.18% -0.998 10.496 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255168000.914op/s 255622041.252op/s ± 155334.095op/s 255636612.252op/s ± 89073.124op/s 255720840.518op/s 255799563.031op/s 255829826.008op/s 256693264.308op/s 0.41% 1.019 10.640 0.06% 10983.779op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.500µs 77.738µs ± 0.614µs 77.681µs ± 0.397µs 78.129µs 78.774µs 79.205µs 79.993µs 2.98% 0.445 0.150 0.79% 0.043µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12501122.921op/s 12864582.096op/s ± 101204.089op/s 12873146.025op/s ± 65374.114op/s 12936102.398op/s 13015495.189op/s 13056267.526op/s 13071947.085op/s 1.54% -0.399 0.063 0.78% 7156.210op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.916µs 70.899µs ± 0.620µs 70.849µs ± 0.433µs 71.277µs 72.024µs 72.472µs 72.690µs 2.60% 0.582 -0.171 0.87% 0.044µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13757102.467op/s 14105630.426op/s ± 122776.681op/s 14114471.244op/s ± 86869.793op/s 14201055.512op/s 14275351.602op/s 14292615.967op/s 14302922.399op/s 1.34% -0.543 -0.238 0.87% 8681.622op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.897µs 3.913µs ± 0.002µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.920µs 3.920µs 0.20% -0.612 8.453 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255091988.246op/s 255587123.682op/s ± 161666.867op/s 255600660.803op/s ± 89668.213op/s 255689030.941op/s 255777926.584op/s 255835277.523op/s 256633040.746op/s 0.40% 0.631 8.563 0.06% 11431.574op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.671µs 67.855µs ± 0.599µs 67.859µs ± 0.472µs 68.322µs 68.855µs 69.234µs 69.687µs 2.69% 0.197 -0.433 0.88% 0.042µs 1 200
credit_card/is_card_number/378282246310005 throughput 14349880.135op/s 14738418.230op/s ± 129978.435op/s 14736354.513op/s ± 101967.477op/s 14839924.621op/s 14943774.164op/s 14974958.108op/s 14999018.983op/s 1.78% -0.157 -0.475 0.88% 9190.863op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.141µs 52.233µs ± 0.041µs 52.230µs ± 0.026µs 52.256µs 52.307µs 52.336µs 52.395µs 0.32% 0.539 0.646 0.08% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19085752.684op/s 19144856.690op/s ± 14906.222op/s 19145949.071op/s ± 9498.259op/s 19155450.170op/s 19166582.681op/s 19171944.124op/s 19178947.270op/s 0.17% -0.534 0.633 0.08% 1054.029op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.038µs ± 0.012µs 6.035µs ± 0.002µs 6.038µs 6.071µs 6.075µs 6.111µs 1.26% 3.140 10.916 0.19% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163634652.506op/s 165610109.909op/s ± 314647.448op/s 165690903.570op/s ± 64822.907op/s 165753285.539op/s 165834329.955op/s 165879618.327op/s 165926473.043op/s 0.14% -3.123 10.754 0.19% 22248.934op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.913µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.928µs 3.929µs 0.44% 1.484 12.601 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254489408.223op/s 255584210.740op/s ± 205790.418op/s 255615132.416op/s ± 88038.933op/s 255687080.628op/s 255807329.285op/s 255864752.471op/s 256686837.740op/s 0.42% -1.454 12.569 0.08% 14551.580op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.080µs 64.472µs ± 0.162µs 64.447µs ± 0.102µs 64.578µs 64.762µs 64.852µs 65.065µs 0.96% 0.456 0.347 0.25% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15369309.735op/s 15510652.909op/s ± 38819.839op/s 15516516.487op/s ± 24413.561op/s 15537611.054op/s 15566708.648op/s 15593635.491op/s 15605471.278op/s 0.57% -0.440 0.323 0.25% 2744.977op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.912µs 58.251µs ± 0.185µs 58.217µs ± 0.111µs 58.356µs 58.588µs 58.759µs 59.025µs 1.39% 0.880 1.178 0.32% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16941980.415op/s 17167377.048op/s ± 54514.540op/s 17176972.551op/s ± 32786.042op/s 17204534.687op/s 17244078.883op/s 17260582.972op/s 17267538.523op/s 0.53% -0.858 1.106 0.32% 3854.760op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.918µs 3.919µs 3.920µs 0.14% -1.066 5.517 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255133997.753op/s 255499280.894op/s ± 177203.869op/s 255501708.496op/s ± 116990.012op/s 255617612.054op/s 255742287.371op/s 255891195.243op/s 256578075.624op/s 0.42% 1.079 5.604 0.07% 12530.206op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.603µs 54.993µs ± 0.272µs 54.941µs ± 0.196µs 55.187µs 55.524µs 55.670µs 55.753µs 1.48% 0.653 -0.416 0.49% 0.019µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17936279.298op/s 18184546.012op/s ± 89636.886op/s 18201459.785op/s ± 65062.325op/s 18263993.874op/s 18294981.691op/s 18309571.932op/s 18314124.467op/s 0.62% -0.636 -0.449 0.49% 6338.285op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.148µs 52.223µs ± 0.045µs 52.215µs ± 0.023µs 52.237µs 52.295µs 52.400µs 52.424µs 0.40% 1.692 4.276 0.09% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19075128.486op/s 19148774.714op/s ± 16487.384op/s 19151660.252op/s ± 8326.434op/s 19159959.996op/s 19167675.443op/s 19173081.206op/s 19176370.876op/s 0.13% -1.683 4.234 0.09% 1165.834op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.038µs ± 0.011µs 6.035µs ± 0.002µs 6.038µs 6.058µs 6.077µs 6.110µs 1.23% 3.644 15.399 0.17% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163674220.540op/s 165622355.357op/s ± 287551.457op/s 165691408.902op/s ± 64425.851op/s 165755213.063op/s 165827472.410op/s 165846591.992op/s 165866579.806op/s 0.11% -3.622 15.191 0.17% 20332.958op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.912µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255600513.441op/s; 255643569.064op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.653µs; 77.823µs] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12850556.182op/s; 12878608.009op/s] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.813µs; 70.985µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14088614.759op/s; 14122646.094op/s] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255564718.209op/s; 255609529.155op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.772µs; 67.938µs] or [-0.122%; +0.122%] None None None
credit_card/is_card_number/378282246310005 throughput [14720404.469op/s; 14756431.991op/s] or [-0.122%; +0.122%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.228µs; 52.239µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19142790.831op/s; 19146922.549op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.040µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 throughput [165566502.799op/s; 165653717.019op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255555690.168op/s; 255612731.313op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.450µs; 64.495µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15505272.852op/s; 15516032.965op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.225µs; 58.276µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17159821.857op/s; 17174932.239op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255474722.142op/s; 255523839.646op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.955µs; 55.031µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18172123.202op/s; 18196968.823op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.216µs; 52.229µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19146489.721op/s; 19151059.707op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165582503.491op/s; 165662207.223op/s] or [-0.024%; +0.024%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.469µs 146.186µs ± 1.678µs 145.863µs ± 0.500µs 146.470µs 148.115µs 151.989µs 162.441µs 11.36% 5.870 47.745 1.15% 0.119µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.954µs; 146.419µs] or [-0.159%; +0.159%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.148ms 4.156ms ± 0.010ms 4.154ms ± 0.002ms 4.157ms 4.166ms 4.169ms 4.272ms 2.85% 8.748 100.669 0.23% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.155ms; 4.157ms] or [-0.032%; +0.032%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.775ms 14.828ms ± 0.031ms 14.822ms ± 0.014ms 14.838ms 14.889ms 14.952ms 15.001ms 1.21% 2.286 7.877 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.823ms; 14.832ms] or [-0.029%; +0.029%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.606ms 10.629ms ± 0.015ms 10.627ms ± 0.009ms 10.636ms 10.652ms 10.677ms 10.711ms 0.79% 1.920 7.074 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.627ms; 10.631ms] or [-0.020%; +0.020%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bc602f0 1773050982 igor/rd-week-dynamic-pipeline-refactor-binstall
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.277µs 89.647µs ± 0.151µs 89.656µs ± 0.091µs 89.742µs 89.815µs 89.898µs 90.855µs 1.34% 2.313 18.745 0.17% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.626µs; 89.668µs] or [-0.023%; +0.023%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 9, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.51 MB 8.51 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 97.27 MB 97.28 MB +.01% (+14.55 KB) 🔍
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 112.87 MB 112.87 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.12 MB 11.12 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.15 MB 27.15 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 185.89 MB 185.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 914.84 MB 914.84 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.76 MB 24.76 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.40 MB 51.40 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.96 MB 22.96 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.10 MB 190.10 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 898.43 MB 898.43 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.51 MB 26.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.03 MB 47.03 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 85.23 MB 85.23 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.04 MB 10.04 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.85 MB 105.85 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.78 MB 11.78 MB 0% (0 B) 👌

Base automatically changed from igor/rd-week-dynamic-pipeline-refactor to julio/rd-week-dynamic-pipeline March 9, 2026 10:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@iunanua @codecov-commenter