fix(crashtracker): Fix bin_tests on aarch64 in Gitlab#1808
fix(crashtracker): Fix bin_tests on aarch64 in Gitlab#1808
bin_tests on aarch64 in Gitlab#1808Conversation
d1cb90e to
642c3d8
Compare
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🎯 Code Coverage (details) 🔗 Commit SHA: 6949210 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## main #1808 +/- ##
==========================================
+ Coverage 71.10% 71.15% +0.05%
==========================================
Files 411 414 +3
Lines 64989 65786 +797
==========================================
+ Hits 46209 46809 +600
- Misses 18780 18977 +197
🚀 New features to boost your workflow:
|
BenchmarksComparisonBenchmark execution time: 2026-03-27 13:17:05 Comparing candidate commit 6949210 in PR branch Found 12 performance improvements and 4 performance regressions! Performance is the same for 46 metrics, 0 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.234ms | 4.239ms ± 0.002ms | 4.239ms ± 0.001ms | 4.240ms | 4.243ms | 4.246ms | 4.246ms | 0.16% | 0.413 | 1.131 | 0.05% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.239ms; 4.240ms] or [-0.007%; +0.007%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 5.363µs | 5.519µs ± 0.054µs | 5.506µs ± 0.034µs | 5.569µs | 5.600µs | 5.614µs | 5.623µs | 2.13% | 0.066 | -0.682 | 0.98% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [5.512µs; 5.527µs] or [-0.136%; +0.136%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.665µs | 162.571µs ± 0.335µs | 162.612µs ± 0.195µs | 162.755µs | 163.020µs | 163.184µs | 164.703µs | 1.29% | 1.201 | 8.152 | 0.21% | 0.024µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [162.525µs; 162.618µs] or [-0.029%; +0.029%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | 912.062µs | 914.419µs ± 1.125µs | 914.372µs ± 0.617µs | 914.974µs | 916.334µs | 917.872µs | 918.754µs | 0.48% | 0.875 | 1.760 | 0.12% | 0.080µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | [914.263µs; 914.575µs] or [-0.017%; +0.017%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 742.976µs | 744.250µs ± 0.551µs | 744.209µs ± 0.345µs | 744.557µs | 745.068µs | 745.765µs | 746.751µs | 0.34% | 0.929 | 2.861 | 0.07% | 0.039µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [744.174µs; 744.326µs] or [-0.010%; +0.010%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 285.899µs | 286.820µs ± 0.441µs | 286.753µs ± 0.169µs | 286.927µs | 287.250µs | 288.905µs | 290.457µs | 1.29% | 4.217 | 27.600 | 0.15% | 0.031µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [286.759µs; 286.881µs] or [-0.021%; +0.021%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.321µs | 2.360µs ± 0.016µs | 2.358µs ± 0.004µs | 2.364µs | 2.395µs | 2.418µs | 2.442µs | 3.53% | 2.137 | 6.936 | 0.67% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.358µs; 2.363µs] or [-0.093%; +0.093%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.137ms | 4.144ms ± 0.007ms | 4.143ms ± 0.001ms | 4.144ms | 4.147ms | 4.151ms | 4.237ms | 2.27% | 11.317 | 144.500 | 0.17% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.143ms; 4.144ms] or [-0.024%; +0.024%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.211µs | 34.714µs ± 0.818µs | 34.348µs ± 0.058µs | 34.427µs | 36.413µs | 36.509µs | 38.195µs | 11.20% | 1.816 | 1.838 | 2.35% | 0.058µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.601µs; 34.828µs] or [-0.327%; +0.327%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 13.597µs | 13.763µs ± 0.068µs | 13.765µs ± 0.051µs | 13.811µs | 13.878µs | 13.928µs | 13.951µs | 1.35% | 0.149 | -0.203 | 0.49% | 0.005µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [13.753µs; 13.772µs] or [-0.068%; +0.068%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.921µs | 3.923µs | 3.924µs | 0.24% | -0.651 | 6.234 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254842430.078op/s | 255428629.172op/s ± 212515.420op/s | 255442946.818op/s ± 135745.866op/s | 255575912.440op/s | 255691383.748op/s | 255746956.663op/s | 256735591.381op/s | 0.51% | 0.671 | 6.347 | 0.08% | 15027.109op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.102µs | 79.930µs ± 0.182µs | 79.943µs ± 0.085µs | 80.022µs | 80.085µs | 80.224µs | 81.519µs | 1.97% | 2.330 | 30.370 | 0.23% | 0.013µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12267138.556op/s | 12510969.967op/s ± 28388.715op/s | 12508938.681op/s ± 13222.633op/s | 12523575.822op/s | 12544618.610op/s | 12611650.294op/s | 12641902.851op/s | 1.06% | -2.149 | 28.976 | 0.23% | 2007.385op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.828µs | 67.955µs ± 0.074µs | 67.946µs ± 0.047µs | 67.997µs | 68.057µs | 68.139µs | 68.450µs | 0.74% | 1.861 | 9.071 | 0.11% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14609104.295op/s | 14715565.057op/s ± 15938.436op/s | 14717610.815op/s ± 10274.906op/s | 14727474.552op/s | 14736511.645op/s | 14739512.035op/s | 14743097.541op/s | 0.17% | -1.837 | 8.869 | 0.11% | 1127.018op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.894µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.923µs | 3.927µs | 0.34% | -0.466 | 8.525 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254637923.311op/s | 255496684.466op/s ± 203289.397op/s | 255504266.930op/s ± 115741.616op/s | 255626362.502op/s | 255736625.428op/s | 255863717.441op/s | 256782680.847op/s | 0.50% | 0.491 | 8.635 | 0.08% | 14374.731op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.810µs | 64.910µs ± 0.053µs | 64.903µs ± 0.035µs | 64.941µs | 64.999µs | 65.054µs | 65.192µs | 0.44% | 1.100 | 3.190 | 0.08% | 0.004µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15339369.194op/s | 15405960.144op/s ± 12680.307op/s | 15407496.477op/s ± 8414.226op/s | 15415520.252op/s | 15423715.000op/s | 15425707.064op/s | 15429631.622op/s | 0.14% | -1.090 | 3.139 | 0.08% | 896.633op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.404µs | 45.656µs ± 0.071µs | 45.656µs ± 0.045µs | 45.701µs | 45.774µs | 45.809µs | 45.825µs | 0.37% | -0.262 | 0.414 | 0.16% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21822045.583op/s | 21903140.685op/s ± 34206.079op/s | 21903012.367op/s ± 21507.778op/s | 21924203.644op/s | 21956863.333op/s | 21986010.922op/s | 22024325.868op/s | 0.55% | 0.273 | 0.430 | 0.16% | 2418.735op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.827µs | 6.836µs ± 0.004µs | 6.836µs ± 0.003µs | 6.838µs | 6.843µs | 6.845µs | 6.865µs | 0.43% | 1.439 | 8.316 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 145661608.867op/s | 146280101.691op/s ± 93814.901op/s | 146284793.707op/s ± 53500.480op/s | 146338347.977op/s | 146429779.983op/s | 146455262.216op/s | 146485773.258op/s | 0.14% | -1.423 | 8.198 | 0.06% | 6633.715op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.897µs | 3.914µs ± 0.003µs | 3.914µs ± 0.001µs | 3.915µs | 3.918µs | 3.919µs | 3.921µs | 0.18% | -1.198 | 8.706 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255050346.240op/s | 255496492.397op/s ± 163352.936op/s | 255498160.417op/s ± 92501.965op/s | 255589366.823op/s | 255724976.619op/s | 255754499.001op/s | 256591282.725op/s | 0.43% | 1.216 | 8.835 | 0.06% | 11550.797op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.189µs | 65.760µs ± 0.059µs | 65.765µs ± 0.028µs | 65.790µs | 65.828µs | 65.862µs | 65.882µs | 0.18% | -4.575 | 42.390 | 0.09% | 0.004µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15178657.260op/s | 15206865.500op/s ± 13686.120op/s | 15205598.324op/s ± 6458.771op/s | 15212507.167op/s | 15224538.889op/s | 15232492.177op/s | 15340085.177op/s | 0.88% | 4.639 | 43.186 | 0.09% | 967.755op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.354µs | 53.424µs ± 0.028µs | 53.424µs ± 0.018µs | 53.441µs | 53.473µs | 53.487µs | 53.503µs | 0.15% | 0.112 | -0.132 | 0.05% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18690700.521op/s | 18718253.395op/s ± 9946.852op/s | 18718320.736op/s ± 6456.218op/s | 18724930.351op/s | 18733823.334op/s | 18742044.575op/s | 18742729.715op/s | 0.13% | -0.110 | -0.132 | 0.05% | 703.349op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.913µs ± 0.001µs | 3.915µs | 3.918µs | 3.919µs | 3.934µs | 0.52% | 0.682 | 18.764 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254212970.573op/s | 255511280.090op/s ± 184697.930op/s | 255529999.222op/s ± 82634.146op/s | 255601218.082op/s | 255712370.405op/s | 255757733.723op/s | 256694579.565op/s | 0.46% | -0.638 | 18.707 | 0.07% | 13060.116op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.150µs | 50.235µs ± 0.039µs | 50.231µs ± 0.027µs | 50.266µs | 50.298µs | 50.325µs | 50.351µs | 0.24% | 0.275 | -0.327 | 0.08% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19860716.793op/s | 19906283.986op/s ± 15422.524op/s | 19907941.696op/s ± 10689.119op/s | 19917664.855op/s | 19929968.284op/s | 19935628.852op/s | 19940268.924op/s | 0.16% | -0.271 | -0.331 | 0.08% | 1090.537op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.434µs | 45.646µs ± 0.085µs | 45.658µs ± 0.057µs | 45.706µs | 45.785µs | 45.806µs | 45.812µs | 0.34% | -0.315 | -0.492 | 0.19% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21828139.582op/s | 21907607.159op/s ± 40932.547op/s | 21901881.405op/s ± 27520.474op/s | 21935803.086op/s | 21978014.702op/s | 22005247.512op/s | 22009926.376op/s | 0.49% | 0.323 | -0.487 | 0.19% | 2894.368op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.827µs | 6.837µs ± 0.004µs | 6.836µs ± 0.003µs | 6.839µs | 6.845µs | 6.848µs | 6.851µs | 0.23% | 0.555 | 0.359 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 145957685.440op/s | 146270343.414op/s ± 94566.643op/s | 146287689.891op/s ± 63139.856op/s | 146336459.750op/s | 146399872.529op/s | 146462561.580op/s | 146472500.664op/s | 0.13% | -0.551 | 0.353 | 0.06% | 6686.871op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.915µs; 3.915µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255399176.578op/s; 255458081.765op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.905µs; 79.956µs] or [-0.032%; +0.032%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12507035.564op/s; 12514904.370op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.945µs; 67.966µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14713356.143op/s; 14717773.971op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255468510.511op/s; 255524858.421op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.903µs; 64.917µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15404202.776op/s; 15407717.513op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.646µs; 45.666µs] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21898400.052op/s; 21907881.319op/s] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.836µs; 6.837µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [146267099.848op/s; 146293103.534op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.914µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255473853.251op/s; 255519131.543op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.752µs; 65.768µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15204968.735op/s; 15208762.264op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.420µs; 53.428µs] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18716874.857op/s; 18719631.933op/s] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.913µs; 3.914µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255485682.733op/s; 255536877.447op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.230µs; 50.241µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19904146.572op/s; 19908421.399op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.635µs; 45.658µs] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21901934.302op/s; 21913280.017op/s] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.836µs; 6.837µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [146257237.387op/s; 146283449.442op/s] or [-0.009%; +0.009%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.296µs | 496.571µs ± 1.151µs | 496.248µs ± 0.378µs | 496.668µs | 499.351µs | 500.515µs | 501.757µs | 1.11% | 2.218 | 5.020 | 0.23% | 0.081µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1992998.375op/s | 2013821.602op/s ± 4642.236op/s | 2015123.502op/s ± 1536.299op/s | 2016613.478op/s | 2017750.114op/s | 2018679.707op/s | 2018993.343op/s | 0.19% | -2.204 | 4.946 | 0.23% | 328.256op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.754µs | 371.435µs ± 0.340µs | 371.422µs ± 0.198µs | 371.619µs | 372.049µs | 372.268µs | 372.438µs | 0.27% | 0.301 | -0.150 | 0.09% | 0.024µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2685011.286op/s | 2692260.383op/s ± 2466.120op/s | 2692357.690op/s ± 1437.014op/s | 2693780.150op/s | 2696115.500op/s | 2697111.828op/s | 2697204.336op/s | 0.18% | -0.296 | -0.155 | 0.09% | 174.381op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 168.301µs | 168.742µs ± 0.143µs | 168.729µs ± 0.101µs | 168.833µs | 168.978µs | 169.101µs | 169.168µs | 0.26% | 0.249 | 0.094 | 0.08% | 0.010µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5911284.270op/s | 5926225.204op/s ± 5026.405op/s | 5926646.721op/s ± 3554.981op/s | 5929555.979op/s | 5933073.332op/s | 5935608.538op/s | 5941752.585op/s | 0.25% | -0.243 | 0.092 | 0.08% | 355.421op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.836µs | 37.077µs ± 0.136µs | 37.082µs ± 0.107µs | 37.181µs | 37.281µs | 37.356µs | 37.590µs | 1.37% | 0.241 | -0.201 | 0.36% | 0.010µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26603163.164op/s | 26970989.789op/s ± 98577.414op/s | 26967305.315op/s ± 78163.130op/s | 27056755.972op/s | 27119718.838op/s | 27139862.979op/s | 27147647.112op/s | 0.67% | -0.222 | -0.247 | 0.36% | 6970.476op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.270µs | 46.400µs ± 0.101µs | 46.394µs ± 0.046µs | 46.442µs | 46.493µs | 46.554µs | 47.542µs | 2.47% | 7.283 | 79.983 | 0.22% | 0.007µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21033939.664op/s | 21552028.711op/s ± 46199.739op/s | 21554312.619op/s ± 21384.044op/s | 21575443.693op/s | 21598278.099op/s | 21603428.577op/s | 21612203.114op/s | 0.27% | -7.096 | 77.191 | 0.21% | 3266.815op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [496.412µs; 496.730µs] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2013178.233op/s; 2014464.971op/s] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [371.388µs; 371.483µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2691918.602op/s; 2692602.164op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.722µs; 168.761µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5925528.592op/s; 5926921.815op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.059µs; 37.096µs] or [-0.051%; +0.051%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26957327.907op/s; 26984651.670op/s] or [-0.051%; +0.051%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.386µs; 46.414µs] or [-0.030%; +0.030%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21545625.871op/s; 21558431.550op/s] or [-0.030%; +0.030%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.430ns | 192.976ns ± 1.919ns | 192.945ns ± 1.116ns | 193.964ns | 195.977ns | 198.828ns | 204.502ns | 5.99% | 1.568 | 6.249 | 0.99% | 0.136ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.710ns; 193.242ns] or [-0.138%; +0.138%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 243.647ns | 255.407ns ± 13.220ns | 250.097ns ± 4.768ns | 258.577ns | 286.236ns | 290.119ns | 292.307ns | 16.88% | 1.416 | 0.769 | 5.16% | 0.935ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [253.575ns; 257.239ns] or [-0.717%; +0.717%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.534µs | 186.018µs ± 0.268µs | 186.003µs ± 0.151µs | 186.147µs | 186.407µs | 186.622µs | 188.145µs | 1.15% | 2.668 | 18.337 | 0.14% | 0.019µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5315043.913op/s | 5375826.527op/s ± 7714.165op/s | 5376266.044op/s ± 4355.411op/s | 5381143.538op/s | 5385675.203op/s | 5386875.507op/s | 5389857.124op/s | 0.25% | -2.612 | 17.766 | 0.14% | 545.474op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.791µs | 17.879µs ± 0.038µs | 17.878µs ± 0.023µs | 17.900µs | 17.937µs | 17.965µs | 18.125µs | 1.38% | 1.427 | 7.948 | 0.21% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 55170955.783op/s | 55931725.540op/s ± 117878.118op/s | 55934076.755op/s ± 70458.254op/s | 56010365.213op/s | 56082303.751op/s | 56169843.649op/s | 56207425.237op/s | 0.49% | -1.378 | 7.595 | 0.21% | 8335.242op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.544µs | 10.588µs ± 0.021µs | 10.582µs ± 0.011µs | 10.607µs | 10.620µs | 10.635µs | 10.657µs | 0.71% | 0.322 | -0.110 | 0.20% | 0.001µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 93837121.679op/s | 94447410.064op/s ± 187365.390op/s | 94503946.304op/s ± 101744.641op/s | 94560463.476op/s | 94784638.155op/s | 94829523.050op/s | 94841628.959op/s | 0.36% | -0.311 | -0.119 | 0.20% | 13248.734op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [185.981µs; 186.055µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5374757.418op/s; 5376895.636op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.874µs; 17.884µs] or [-0.029%; +0.029%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55915388.766op/s; 55948062.313op/s] or [-0.029%; +0.029%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.585µs; 10.591µs] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [94421443.023op/s; 94473377.105op/s] or [-0.027%; +0.027%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 146.370µs | 148.247µs ± 1.847µs | 148.023µs ± 0.550µs | 148.520µs | 149.861µs | 154.221µs | 166.984µs | 12.81% | 6.466 | 56.609 | 1.24% | 0.131µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [147.991µs; 148.503µs] or [-0.173%; +0.173%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 14.733ms | 14.767ms ± 0.020ms | 14.764ms ± 0.014ms | 14.780ms | 14.801ms | 14.820ms | 14.833ms | 0.47% | 0.575 | 0.151 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [14.765ms; 14.770ms] or [-0.018%; +0.018%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.970µs | 5.055µs ± 0.046µs | 5.047µs ± 0.032µs | 5.078µs | 5.127µs | 5.143µs | 5.144µs | 1.93% | 0.321 | -0.898 | 0.91% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.049µs; 5.061µs] or [-0.126%; +0.126%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.385ms | 3.514ms ± 0.072ms | 3.555ms ± 0.030ms | 3.571ms | 3.593ms | 3.604ms | 3.616ms | 1.73% | -0.534 | -1.387 | 2.06% | 0.005ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.504ms; 3.524ms] or [-0.286%; +0.286%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 13.948ms | 14.062ms ± 0.058ms | 14.070ms ± 0.046ms | 14.106ms | 14.139ms | 14.206ms | 14.275ms | 1.45% | 0.368 | -0.076 | 0.41% | 0.004ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.054ms; 14.070ms] or [-0.057%; +0.057%] | None | None | None |
Group 21
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 6949210 | 1774616366 | gleocadie/fix-bin_tests-on-aarch64-gitlab |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.123ms | 49.494ms ± 0.684ms | 49.393ms ± 0.062ms | 49.451ms | 49.623ms | 52.298ms | 56.459ms | 14.30% | 7.544 | 63.863 | 1.38% | 0.048ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.399ms; 49.588ms] or [-0.192%; +0.192%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
📚 Documentation Check Results📦
|
🔒 Cargo Deny Results📦
|
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.