Skip to content

fix(ci): skip? fix? semver checks#1703

Closed
gyuheon0h wants to merge 2 commits intomainfrom
gyuheon0h/recursive-checkout-semver
Closed

fix(ci): skip? fix? semver checks#1703
gyuheon0h wants to merge 2 commits intomainfrom
gyuheon0h/recursive-checkout-semver

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Mar 11, 2026 •
edited
Loading

What does this PR do?

Motivation

Was getting this in semver test in a libdatadog version bump PR because it could not detect recursive submodule

Compiling libdd-common v2.0.0 (/home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/056fe169e03fd489c36f09086c15a4914ed2f0c9/libdd-common)
    Checking rand_core v0.6.4
error: failed to run custom build command for `libdd-libunwind-sys v28.0.3 (/home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/056fe169e03fd489c36f09086c15a4914ed2f0c9/libdd-libunwind-sys)`

Caused by:
  process didn't exit successfully: `/home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/local-libdd_crashtracker-1_0_0-default-23cbf683669c47bc/target/debug/build/libdd-libunwind-sys-ce5b5ec9658e8a85/build-script-build` (exit status: 101)
  --- stderr
  Initializing libunwind submodule...
  error: pathspec 'libdd-libunwind-sys/libunwind' did not match any file(s) known to git

  thread 'main' (24783) panicked at /home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/056fe169e03fd489c36f09086c15a4914ed2f0c9/libdd-libunwind-sys/build.rs:36:17:
  Failed to initialize libunwind submodule at /home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/056fe169e03fd489c36f09086c15a4914ed2f0c9/libdd-libunwind-sys/libunwind.
  Try manually: git submodule update --init --recursive
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...

-----

error: failed to build rustdoc for crate libdd-crashtracker v1.0.0
note: this is usually due to a compilation error in the crate,
      and is unlikely to be a bug in cargo-semver-checks
note: the following command can be used to reproduce the error:
      cargo new --lib example &&
          cd example &&
          echo '[workspace]' >> Cargo.toml &&
          cargo add --path /home/runner/work/libdatadog/libdatadog/target/semver-checks/git-origin_main/056fe169e03fd489c36f09086c15a4914ed2f0c9/libdd-crashtracker --features benchmarking,collector,collector_windows,cxx,default,generate-unit-test-files,receiver &&
          cargo check &&
          cargo doc

error: aborting due to failure to build rustdoc for crate libdd-crashtracker v1.0.0
Error: unknown level ()

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Mar 11, 2026 •
edited
Loading

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h mentioned this pull request Mar 11, 2026
Merged
@gyuheon0h gyuheon0h changed the title recursive checkout for semver fix(ci): recursive checkout for semver Mar 11, 2026
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/recursive-checkout-semver branch from a684205 to 19e7704 Compare March 11, 2026 04:27
@gyuheon0h gyuheon0h marked this pull request as ready for review March 11, 2026 04:27
@gyuheon0h gyuheon0h requested a review from a team as a code owner March 11, 2026 04:27
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/recursive-checkout-semver branch from 19e7704 to fc0873e Compare March 11, 2026 04:29
@gyuheon0h gyuheon0h changed the title fix(ci): recursive checkout for semver fix(ci): skip libdd-libnwind for semver checks Mar 11, 2026
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/recursive-checkout-semver branch from fc0873e to 6aeb90d Compare March 11, 2026 04:41
@gyuheon0h gyuheon0h changed the title fix(ci): skip libdd-libnwind for semver checks fix(ci): skip? fix? semver checks Mar 11, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 11, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-11 05:06:48

Comparing candidate commit 292a651 in PR branch gyuheon0h/recursive-checkout-semver with baseline commit b04809b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.915µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.921µs 3.923µs 3.926µs 0.30% -0.151 5.371 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254689400.046op/s 255438644.507op/s ± 216736.332op/s 255461629.670op/s ± 100879.485op/s 255549947.238op/s 255734159.147op/s 255815240.378op/s 256673124.516op/s 0.47% 0.169 5.446 0.08% 15325.573op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.616µs 80.174µs ± 0.083µs 80.170µs ± 0.043µs 80.217µs 80.293µs 80.399µs 80.563µs 0.49% -0.623 11.764 0.10% 0.006µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12412682.982op/s 12472906.091op/s ± 12863.959op/s 12473444.660op/s ± 6633.391op/s 12479758.144op/s 12488724.992op/s 12492794.194op/s 12560288.127op/s 0.70% 0.664 11.959 0.10% 909.619op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 67.799µs 67.903µs ± 0.068µs 67.893µs ± 0.026µs 67.925µs 67.985µs 68.132µs 68.533µs 0.94% 4.574 37.173 0.10% 0.005µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 14591438.730op/s 14726996.342op/s ± 14624.248op/s 14729071.421op/s ± 5595.068op/s 14734231.181op/s 14742512.457op/s 14747871.393op/s 14749403.646op/s 0.14% -4.520 36.496 0.10% 1034.091op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.919µs 3.922µs 3.923µs 0.22% -1.507 13.453 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254906602.919op/s 255456186.952op/s ± 179796.370op/s 255457325.866op/s ± 103638.203op/s 255563379.725op/s 255683336.480op/s 255727490.729op/s 256774758.288op/s 0.52% 1.535 13.666 0.07% 12713.523op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 64.579µs 64.694µs ± 0.052µs 64.689µs ± 0.033µs 64.724µs 64.779µs 64.832µs 64.920µs 0.36% 0.821 1.742 0.08% 0.004µs 1 200
credit_card/is_card_number/378282246310005 throughput 15403455.760op/s 15457431.642op/s ± 12377.095op/s 15458690.514op/s ± 7834.399op/s 15466281.187op/s 15475627.898op/s 15481248.865op/s 15484978.023op/s 0.17% -0.814 1.717 0.08% 875.193op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.348µs 45.717µs ± 0.099µs 45.722µs ± 0.064µs 45.781µs 45.862µs 45.915µs 45.962µs 0.53% -0.329 0.461 0.22% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21756999.942op/s 21873771.734op/s ± 47208.018op/s 21871535.290op/s ± 30426.035op/s 21903435.581op/s 21953285.809op/s 21991924.530op/s 22051908.985op/s 0.82% 0.344 0.489 0.22% 3338.111op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.568µs 6.627µs ± 0.014µs 6.630µs ± 0.009µs 6.637µs 6.642µs 6.645µs 6.647µs 0.26% -1.213 1.865 0.21% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150437439.196op/s 150906672.939op/s ± 312372.099op/s 150835159.816op/s ± 198846.983op/s 151071948.019op/s 151485108.173op/s 151866270.937op/s 152249373.585op/s 0.94% 1.227 1.931 0.21% 22088.043op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.920µs 3.930µs 0.41% -0.434 11.933 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254430070.667op/s 255469257.483op/s ± 193814.235op/s 255478756.942op/s ± 104039.136op/s 255577037.320op/s 255702631.551op/s 255766752.553op/s 256751019.342op/s 0.50% 0.465 12.031 0.08% 13704.736op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.571µs 65.699µs ± 0.060µs 65.690µs ± 0.031µs 65.727µs 65.785µs 65.955µs 65.999µs 0.47% 1.701 6.067 0.09% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15151849.759op/s 15220979.388op/s ± 13846.918op/s 15223092.937op/s ± 7292.270op/s 15229676.589op/s 15239070.387op/s 15244495.145op/s 15250653.461op/s 0.18% -1.687 5.992 0.09% 979.125op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.354µs 53.441µs ± 0.038µs 53.440µs ± 0.023µs 53.460µs 53.504µs 53.549µs 53.591µs 0.28% 0.684 1.621 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18659892.199op/s 18712305.694op/s ± 13282.013op/s 18712642.834op/s ± 8118.735op/s 18721052.853op/s 18733060.875op/s 18739219.286op/s 18742716.635op/s 0.16% -0.678 1.603 0.07% 939.180op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.899µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.918µs 3.920µs 3.929µs 0.38% 0.175 6.858 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254517891.890op/s 255484707.217op/s ± 178838.444op/s 255490596.966op/s ± 108346.031op/s 255605788.227op/s 255728348.808op/s 255787036.291op/s 256446043.411op/s 0.37% -0.157 6.858 0.07% 12645.788op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.140µs 50.206µs ± 0.030µs 50.207µs ± 0.017µs 50.222µs 50.262µs 50.283µs 50.290µs 0.17% 0.224 0.148 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19884518.669op/s 19918076.987op/s ± 11937.206op/s 19917601.877op/s ± 6794.007op/s 19924844.483op/s 19937693.116op/s 19941965.610op/s 19944013.166op/s 0.13% -0.220 0.145 0.06% 844.088op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.482µs 45.727µs ± 0.090µs 45.734µs ± 0.061µs 45.790µs 45.880µs 45.906µs 45.961µs 0.50% -0.107 -0.311 0.20% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21757501.420op/s 21868938.954op/s ± 43247.487op/s 21865477.703op/s ± 29381.755op/s 21898999.766op/s 21941549.764op/s 21962329.229op/s 21986764.169op/s 0.55% 0.117 -0.308 0.20% 3058.059op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.564µs 6.628µs ± 0.013µs 6.633µs ± 0.005µs 6.637µs 6.641µs 6.644µs 6.646µs 0.20% -1.712 3.743 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150459894.118op/s 150867323.724op/s ± 289717.641op/s 150761826.470op/s ± 107570.454op/s 151006962.872op/s 151475774.314op/s 151742455.581op/s 152349112.329op/s 1.05% 1.728 3.839 0.19% 20486.131op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255408606.936op/s; 255468682.078op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.162µs; 80.185µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12471123.270op/s; 12474688.912op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [67.893µs; 67.912µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14724969.562op/s; 14729023.122op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255431268.904op/s; 255481105.000op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [64.687µs; 64.701µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 throughput [15455716.295op/s; 15459146.988op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.703µs; 45.731µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21867229.157op/s; 21880314.311op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.625µs; 6.629µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 throughput [150863381.171op/s; 150949964.708op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255442396.694op/s; 255496118.272op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.691µs; 65.707µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15219060.338op/s; 15222898.437op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.436µs; 53.446µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18710464.935op/s; 18714146.453op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255459921.928op/s; 255509492.505op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.201µs; 50.210µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19916422.605op/s; 19919731.369op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.715µs; 45.740µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21862945.268op/s; 21874932.640op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.627µs; 6.630µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150827171.645op/s; 150907475.802op/s] or [-0.027%; +0.027%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.477ms 48.766ms ± 0.778ms 48.647ms ± 0.062ms 48.713ms 48.853ms 52.197ms 56.481ms 16.10% 7.839 66.250 1.59% 0.055ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.658ms; 48.874ms] or [-0.221%; +0.221%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.910ms 13.966ms ± 0.035ms 13.963ms ± 0.017ms 13.979ms 14.013ms 14.132ms 14.163ms 1.44% 2.245 9.066 0.25% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [13.961ms; 13.971ms] or [-0.035%; +0.035%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.399µs 2.430µs ± 0.020µs 2.425µs ± 0.011µs 2.439µs 2.484µs 2.487µs 2.493µs 2.81% 1.376 2.028 0.81% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.427µs; 2.433µs] or [-0.113%; +0.113%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.136ms 4.142ms ± 0.006ms 4.142ms ± 0.001ms 4.143ms 4.146ms 4.151ms 4.221ms 1.93% 10.715 134.501 0.15% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.141ms; 4.143ms] or [-0.021%; +0.021%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.939ns 254.097ns ± 10.107ns 249.552ns ± 2.491ns 256.474ns 279.830ns 284.299ns 285.015ns 14.21% 1.843 2.313 3.97% 0.715ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.696ns; 255.497ns] or [-0.551%; +0.551%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 163.340µs 164.042µs ± 0.400µs 163.956µs ± 0.179µs 164.208µs 164.570µs 165.036µs 167.936µs 2.43% 4.918 43.454 0.24% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [163.987µs; 164.097µs] or [-0.034%; +0.034%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.989µs 5.060µs ± 0.051µs 5.046µs ± 0.038µs 5.103µs 5.156µs 5.158µs 5.164µs 2.33% 0.597 -0.981 1.01% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.053µs; 5.068µs] or [-0.141%; +0.141%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.963µs 89.348µs ± 0.264µs 89.331µs ± 0.132µs 89.467µs 89.591µs 89.707µs 92.278µs 3.30% 6.821 73.865 0.29% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.311µs; 89.384µs] or [-0.041%; +0.041%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.276µs 3.185µs ± 1.385µs 2.979µs ± 0.023µs 2.999µs 3.676µs 13.642µs 14.579µs 389.44% 7.331 54.979 43.37% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.993µs; 3.377µs] or [-6.025%; +6.025%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.681ms 10.707ms ± 0.014ms 10.705ms ± 0.008ms 10.713ms 10.730ms 10.747ms 10.790ms 0.80% 1.925 7.582 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.705ms; 10.709ms] or [-0.018%; +0.018%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.729µs 146.366µs ± 1.687µs 146.104µs ± 0.424µs 146.547µs 148.211µs 151.468µs 162.684µs 11.35% 6.047 49.582 1.15% 0.119µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.132µs; 146.599µs] or [-0.160%; +0.160%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.815µs 25.377µs ± 9.818µs 17.992µs ± 0.139µs 34.158µs 42.562µs 50.195µs 61.938µs 244.24% 0.994 0.186 38.59% 0.694µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.016µs; 26.737µs] or [-5.362%; +5.362%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.176µs 32.987µs ± 1.093µs 32.298µs ± 0.058µs 34.539µs 34.701µs 35.236µs 35.712µs 10.57% 0.938 -1.015 3.31% 0.077µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [32.835µs; 33.138µs] or [-0.459%; +0.459%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.388ms 3.419ms ± 0.019ms 3.415ms ± 0.010ms 3.428ms 3.461ms 3.476ms 3.493ms 2.29% 1.239 1.457 0.57% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.416ms; 3.422ms] or [-0.079%; +0.079%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 749.931µs 751.122µs ± 0.392µs 751.089µs ± 0.230µs 751.316µs 751.856µs 752.490µs 752.662µs 0.21% 0.859 2.172 0.05% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [751.068µs; 751.176µs] or [-0.007%; +0.007%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.028ns 192.437ns ± 1.963ns 192.138ns ± 1.390ns 193.470ns 196.112ns 197.787ns 198.515ns 3.32% 0.828 0.193 1.02% 0.139ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.165ns; 192.709ns] or [-0.141%; +0.141%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 493.239µs 494.133µs ± 0.509µs 494.069µs ± 0.277µs 494.357µs 494.994µs 495.242µs 497.686µs 0.73% 2.025 10.572 0.10% 0.036µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2009299.260op/s 2023747.554op/s ± 2080.516op/s 2024009.247op/s ± 1134.298op/s 2025087.686op/s 2026368.081op/s 2027104.427op/s 2027416.528op/s 0.17% -1.999 10.346 0.10% 147.115op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 371.676µs 372.313µs ± 0.277µs 372.280µs ± 0.187µs 372.503µs 372.828µs 372.998µs 373.275µs 0.27% 0.507 0.254 0.07% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2678990.021op/s 2685910.034op/s ± 1995.007op/s 2686146.759op/s ± 1350.583op/s 2687370.088op/s 2689020.266op/s 2689537.857op/s 2690513.821op/s 0.16% -0.503 0.247 0.07% 141.068op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.326µs 167.632µs ± 0.182µs 167.598µs ± 0.089µs 167.699µs 167.984µs 168.247µs 168.444µs 0.51% 1.407 3.033 0.11% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5936674.733op/s 5965456.321op/s ± 6450.836op/s 5966660.383op/s ± 3178.839op/s 5969650.298op/s 5973607.892op/s 5976087.024op/s 5976351.715op/s 0.16% -1.397 2.993 0.11% 456.143op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.144µs 37.232µs ± 0.042µs 37.226µs ± 0.026µs 37.261µs 37.313µs 37.332µs 37.362µs 0.36% 0.580 0.038 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26765154.086op/s 26858368.925op/s ± 29972.344op/s 26862689.948op/s ± 18740.572op/s 26879398.505op/s 26899106.196op/s 26910681.776op/s 26922108.672op/s 0.22% -0.574 0.030 0.11% 2119.365op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.405µs 45.619µs ± 0.153µs 45.630µs ± 0.072µs 45.689µs 45.749µs 45.826µs 47.121µs 3.27% 5.121 46.725 0.33% 0.011µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21221975.497op/s 21920777.873op/s ± 72258.368op/s 21915331.832op/s ± 34516.302op/s 21958731.043op/s 22006367.201op/s 22021786.824op/s 22024227.139op/s 0.50% -4.900 43.955 0.33% 5109.438op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [494.063µs; 494.204µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2023459.214op/s; 2024035.893op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [372.275µs; 372.352µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2685633.545op/s; 2686186.523op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.607µs; 167.657µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5964562.298op/s; 5966350.345op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.227µs; 37.238µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26854215.047op/s; 26862522.804op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.598µs; 45.641µs] or [-0.046%; +0.046%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21910763.558op/s; 21930792.187op/s] or [-0.046%; +0.046%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 292a651 1773204647 gyuheon0h/recursive-checkout-semver
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.824µs 205.710µs ± 0.569µs 205.568µs ± 0.366µs 206.041µs 206.694µs 207.313µs 207.470µs 0.93% 0.867 0.236 0.28% 0.040µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4819971.461op/s 4861260.609op/s ± 13404.928op/s 4864579.961op/s ± 8671.292op/s 4872080.563op/s 4877618.348op/s 4879376.962op/s 4882237.786op/s 0.36% -0.855 0.205 0.28% 947.872op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.552µs 18.673µs ± 0.104µs 18.629µs ± 0.036µs 18.760µs 18.851µs 18.977µs 19.103µs 2.55% 1.285 1.264 0.55% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52347102.100op/s 53553894.808op/s ± 295261.367op/s 53680955.457op/s ± 104601.994op/s 53764285.980op/s 53848847.539op/s 53886256.745op/s 53901805.528op/s 0.41% -1.258 1.143 0.55% 20878.132op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.577µs 10.675µs ± 0.057µs 10.664µs ± 0.037µs 10.707µs 10.782µs 10.829µs 10.899µs 2.20% 0.981 0.922 0.53% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 91747552.757op/s 93680349.357op/s ± 497262.886op/s 93769852.277op/s ± 325502.928op/s 94047156.075op/s 94277520.095op/s 94428181.585op/s 94543402.278op/s 0.82% -0.951 0.826 0.53% 35161.796op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.631µs; 205.788µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4859402.815op/s; 4863118.403op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.659µs; 18.688µs] or [-0.077%; +0.077%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53512974.422op/s; 53594815.194op/s] or [-0.076%; +0.076%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.667µs; 10.683µs] or [-0.074%; +0.074%] None None None
normalization/normalize_name/normalize_name/good throughput [93611433.503op/s; 93749265.210op/s] or [-0.074%; +0.074%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 11, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.63 MB 8.63 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.28 MB 100.28 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.21 MB 11.21 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 116.94 MB 116.94 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.16 MB 27.16 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.02 MB 186.02 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.15 MB 917.15 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.77 MB 24.77 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.43 MB 51.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.23 MB 190.20 MB --.01% (-24.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.80 MB 900.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.51 MB 26.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.05 MB 47.05 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.50 MB 87.50 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.21 MB 10.21 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.81 MB 109.81 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.95 MB 11.95 MB 0% (0 B) 👌

@gyuheon0h gyuheon0h closed this Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@gyuheon0h