feat(capabilities): trait architecture http draft#1555
feat(capabilities): trait architecture http draft#1555Aaalibaba42 wants to merge 58 commits intomainfrom
Conversation
📚 Documentation Check Results📦
|
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
🔒 Cargo Deny Results📦
|
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## main #1555 +/- ##
==========================================
- Coverage 71.10% 71.00% -0.11%
==========================================
Files 411 412 +1
Lines 64989 64995 +6
==========================================
- Hits 46209 46147 -62
- Misses 18780 18848 +68
🚀 New features to boost your workflow:
|
91daca7 to
b727c1c
Compare
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
b727c1c to
624bdac
Compare
a7a3941 to
3941878
Compare
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🔗 Commit SHA: d743927 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
c0843b5 to
280cf5d
Compare
BenchmarksComparisonBenchmark execution time: 2026-03-27 13:23:29 Comparing candidate commit d743927 in PR branch Found 12 performance improvements and 5 performance regressions! Performance is the same for 45 metrics, 0 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 15.051ms | 15.089ms ± 0.017ms | 15.089ms ± 0.010ms | 15.098ms | 15.118ms | 15.133ms | 15.152ms | 0.42% | 0.531 | 0.910 | 0.11% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [15.086ms; 15.091ms] or [-0.015%; +0.015%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.180ms | 4.185ms ± 0.008ms | 4.184ms ± 0.001ms | 4.185ms | 4.188ms | 4.193ms | 4.289ms | 2.51% | 11.900 | 154.267 | 0.19% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.184ms; 4.186ms] or [-0.026%; +0.026%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.573ms | 3.608ms ± 0.019ms | 3.604ms ± 0.010ms | 3.616ms | 3.642ms | 3.682ms | 3.706ms | 2.83% | 1.733 | 5.092 | 0.53% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.605ms; 3.610ms] or [-0.073%; +0.073%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.460µs | 162.453µs ± 0.355µs | 162.387µs ± 0.175µs | 162.588µs | 162.946µs | 163.671µs | 164.960µs | 1.58% | 2.734 | 15.129 | 0.22% | 0.025µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [162.404µs; 162.503µs] or [-0.030%; +0.030%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 5.522µs | 5.628µs ± 0.038µs | 5.629µs ± 0.028µs | 5.659µs | 5.685µs | 5.696µs | 5.697µs | 1.22% | -0.203 | -0.762 | 0.67% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [5.623µs; 5.633µs] or [-0.093%; +0.093%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.847ns | 193.451ns ± 2.159ns | 193.075ns ± 1.316ns | 194.433ns | 197.247ns | 199.004ns | 205.336ns | 6.35% | 1.373 | 3.774 | 1.11% | 0.153ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [193.152ns; 193.750ns] or [-0.155%; +0.155%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.393µs | 496.178µs ± 0.533µs | 496.108µs ± 0.265µs | 496.379µs | 496.818µs | 498.472µs | 500.064µs | 0.80% | 3.109 | 16.975 | 0.11% | 0.038µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1999742.700op/s | 2015409.440op/s ± 2156.320op/s | 2015688.326op/s ± 1076.479op/s | 2016735.205op/s | 2017822.971op/s | 2018220.891op/s | 2018600.280op/s | 0.14% | -3.079 | 16.709 | 0.11% | 152.475op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.520µs | 371.215µs ± 0.324µs | 371.182µs ± 0.213µs | 371.420µs | 371.707µs | 371.944µs | 373.165µs | 0.53% | 1.084 | 5.511 | 0.09% | 0.023µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2679778.473op/s | 2693855.553op/s ± 2351.947op/s | 2694093.475op/s ± 1547.304op/s | 2695247.935op/s | 2697258.299op/s | 2698662.596op/s | 2698909.324op/s | 0.18% | -1.068 | 5.408 | 0.09% | 166.308op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 168.405µs | 168.725µs ± 0.152µs | 168.715µs ± 0.098µs | 168.813µs | 168.994µs | 169.090µs | 169.372µs | 0.39% | 0.571 | 1.057 | 0.09% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5904158.752op/s | 5926800.978op/s ± 5345.678op/s | 5927166.700op/s ± 3449.438op/s | 5930587.644op/s | 5935079.304op/s | 5937106.300op/s | 5938049.572op/s | 0.18% | -0.563 | 1.036 | 0.09% | 377.997op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.843µs | 37.061µs ± 0.111µs | 37.070µs ± 0.080µs | 37.144µs | 37.220µs | 37.265µs | 37.311µs | 0.65% | -0.212 | -0.918 | 0.30% | 0.008µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26801424.873op/s | 26983089.576op/s ± 80831.422op/s | 26976239.776op/s ± 58423.632op/s | 27041694.923op/s | 27117044.292op/s | 27129646.417op/s | 27142290.614op/s | 0.62% | 0.221 | -0.919 | 0.30% | 5715.645op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.366µs | 46.533µs ± 0.130µs | 46.525µs ± 0.050µs | 46.569µs | 46.651µs | 46.705µs | 48.048µs | 3.27% | 7.996 | 90.502 | 0.28% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20812689.265op/s | 21490364.806op/s ± 58739.881op/s | 21493707.598op/s ± 23111.165op/s | 21518023.647op/s | 21546974.622op/s | 21560030.288op/s | 21567760.512op/s | 0.34% | -7.759 | 86.845 | 0.27% | 4153.537op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [496.104µs; 496.251µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2015110.595op/s; 2015708.285op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [371.170µs; 371.260µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2693529.596op/s; 2694181.510op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.704µs; 168.746µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5926060.118op/s; 5927541.837op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.045µs; 37.076µs] or [-0.041%; +0.041%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26971887.118op/s; 26994292.033op/s] or [-0.042%; +0.042%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.515µs; 46.551µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21482224.023op/s; 21498505.589op/s] or [-0.038%; +0.038%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.073µs | 5.139µs ± 0.043µs | 5.147µs ± 0.038µs | 5.171µs | 5.201µs | 5.206µs | 5.208µs | 1.19% | -0.128 | -1.353 | 0.83% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.133µs; 5.145µs] or [-0.115%; +0.115%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.202ms | 4.207ms ± 0.003ms | 4.206ms ± 0.001ms | 4.207ms | 4.212ms | 4.214ms | 4.221ms | 0.36% | 1.906 | 6.171 | 0.06% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.206ms; 4.207ms] or [-0.008%; +0.008%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 242.794ns | 254.882ns ± 13.832ns | 248.886ns ± 4.065ns | 255.859ns | 286.020ns | 288.066ns | 290.052ns | 16.54% | 1.445 | 0.549 | 5.41% | 0.978ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.965ns; 256.799ns] or [-0.752%; +0.752%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.574µs | 186.062µs ± 0.231µs | 186.026µs ± 0.172µs | 186.240µs | 186.464µs | 186.576µs | 186.643µs | 0.33% | 0.266 | -0.603 | 0.12% | 0.016µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5357827.894op/s | 5374548.908op/s ± 6670.453op/s | 5375591.585op/s ± 4961.733op/s | 5379608.547op/s | 5383791.266op/s | 5386932.177op/s | 5388684.463op/s | 0.24% | -0.261 | -0.606 | 0.12% | 471.672op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.810µs | 17.890µs ± 0.048µs | 17.884µs ± 0.019µs | 17.907µs | 17.944µs | 17.966µs | 18.428µs | 3.05% | 7.052 | 76.068 | 0.27% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54264060.776op/s | 55896444.827op/s ± 147731.870op/s | 55917124.250op/s ± 60920.259op/s | 55968506.222op/s | 56034754.736op/s | 56103936.969op/s | 56148045.883op/s | 0.41% | -6.826 | 72.733 | 0.26% | 10446.221op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.538µs | 10.585µs ± 0.020µs | 10.581µs ± 0.011µs | 10.601µs | 10.619µs | 10.639µs | 10.653µs | 0.68% | 0.514 | 0.432 | 0.19% | 0.001µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 93866370.116op/s | 94474124.275op/s ± 175535.041op/s | 94505173.449op/s ± 100634.485op/s | 94589106.008op/s | 94721164.217op/s | 94833803.642op/s | 94893085.916op/s | 0.41% | -0.502 | 0.416 | 0.19% | 12412.202op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [186.030µs; 186.094µs] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5373624.447op/s; 5375473.368op/s] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.884µs; 17.897µs] or [-0.037%; +0.037%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55875970.610op/s; 55916919.043op/s] or [-0.037%; +0.037%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.582µs; 10.588µs] or [-0.026%; +0.026%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [94449796.807op/s; 94498451.744op/s] or [-0.026%; +0.026%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 312.865µs | 313.422µs ± 0.605µs | 313.320µs ± 0.140µs | 313.480µs | 313.871µs | 316.324µs | 318.546µs | 1.67% | 6.254 | 46.450 | 0.19% | 0.043µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [313.338µs; 313.506µs] or [-0.027%; +0.027%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.295ms | 14.361ms ± 0.034ms | 14.358ms ± 0.020ms | 14.378ms | 14.412ms | 14.481ms | 14.536ms | 1.24% | 1.350 | 4.258 | 0.24% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.356ms; 14.366ms] or [-0.033%; +0.033%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.894µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.917µs | 3.918µs | 3.921µs | 0.23% | -1.111 | 11.020 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255031661.941op/s | 255602088.083op/s ± 172678.186op/s | 255615860.965op/s ± 101127.753op/s | 255715564.258op/s | 255805727.923op/s | 255885871.145op/s | 256804206.284op/s | 0.46% | 1.135 | 11.183 | 0.07% | 12210.192op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.326µs | 79.702µs ± 0.152µs | 79.705µs ± 0.103µs | 79.805µs | 79.939µs | 80.007µs | 80.394µs | 0.86% | 0.292 | 1.192 | 0.19% | 0.011µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12438769.908op/s | 12546732.459op/s ± 23971.839op/s | 12546196.265op/s ± 16188.330op/s | 12562908.016op/s | 12585453.170op/s | 12599991.019op/s | 12606179.549op/s | 0.48% | -0.274 | 1.138 | 0.19% | 1695.065op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.840µs | 68.002µs ± 0.107µs | 67.985µs ± 0.061µs | 68.058µs | 68.162µs | 68.349µs | 68.674µs | 1.01% | 1.938 | 8.502 | 0.16% | 0.008µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14561649.766op/s | 14705573.516op/s ± 23003.335op/s | 14709031.348op/s ± 13224.061op/s | 14721249.759op/s | 14734683.382op/s | 14740386.832op/s | 14740532.041op/s | 0.21% | -1.907 | 8.275 | 0.16% | 1626.581op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.893µs | 3.912µs ± 0.003µs | 3.912µs ± 0.001µs | 3.914µs | 3.916µs | 3.917µs | 3.918µs | 0.17% | -1.636 | 13.215 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 255214855.262op/s | 255620807.802op/s ± 165786.087op/s | 255636172.518op/s ± 90673.911op/s | 255712046.626op/s | 255829928.432op/s | 255903886.892op/s | 256842940.040op/s | 0.47% | 1.661 | 13.419 | 0.06% | 11722.847op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.630µs | 64.775µs ± 0.095µs | 64.756µs ± 0.056µs | 64.836µs | 64.959µs | 65.047µs | 65.149µs | 0.61% | 0.942 | 0.759 | 0.15% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15349327.927op/s | 15438164.259op/s ± 22718.283op/s | 15442700.632op/s ± 13374.730op/s | 15454921.087op/s | 15467981.434op/s | 15471285.481op/s | 15472676.800op/s | 0.19% | -0.934 | 0.733 | 0.15% | 1606.425op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.455µs | 45.670µs ± 0.094µs | 45.671µs ± 0.062µs | 45.730µs | 45.803µs | 45.824µs | 46.259µs | 1.29% | 1.048 | 6.200 | 0.21% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21617429.926op/s | 21896163.447op/s ± 45173.733op/s | 21895877.007op/s ± 29455.084op/s | 21928313.839op/s | 21966796.859op/s | 21988334.860op/s | 21999585.524op/s | 0.47% | -1.005 | 5.909 | 0.21% | 3194.265op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.427µs | 6.435µs ± 0.005µs | 6.435µs ± 0.003µs | 6.438µs | 6.444µs | 6.448µs | 6.464µs | 0.45% | 1.622 | 5.723 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154706717.631op/s | 155394194.666op/s ± 121232.392op/s | 155407406.732op/s ± 78313.840op/s | 155486390.383op/s | 155542124.236op/s | 155568091.844op/s | 155590111.086op/s | 0.12% | -1.610 | 5.647 | 0.08% | 8572.425op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.896µs | 3.913µs ± 0.003µs | 3.913µs ± 0.002µs | 3.915µs | 3.918µs | 3.920µs | 3.920µs | 0.18% | -0.749 | 5.199 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255086307.195op/s | 255537350.975op/s ± 191167.269op/s | 255541608.756op/s ± 124523.154op/s | 255656436.172op/s | 255804781.960op/s | 255880578.798op/s | 256675418.669op/s | 0.44% | 0.764 | 5.285 | 0.07% | 13517.567op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.842µs | 65.279µs ± 0.094µs | 65.287µs ± 0.058µs | 65.344µs | 65.417µs | 65.433µs | 65.490µs | 0.31% | -0.889 | 1.973 | 0.14% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15269605.206op/s | 15318983.661op/s ± 21989.265op/s | 15317029.946op/s ± 13614.382op/s | 15331878.929op/s | 15359423.628op/s | 15381532.703op/s | 15422123.035op/s | 0.69% | 0.903 | 2.026 | 0.14% | 1554.876op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.589µs | 53.899µs ± 0.116µs | 53.897µs ± 0.083µs | 53.974µs | 54.090µs | 54.156µs | 54.233µs | 0.62% | 0.086 | -0.269 | 0.22% | 0.008µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18438976.109op/s | 18553307.010op/s ± 40023.740op/s | 18554076.805op/s ± 28723.747op/s | 18583451.901op/s | 18614204.317op/s | 18638268.768op/s | 18660559.112op/s | 0.57% | -0.075 | -0.272 | 0.22% | 2830.106op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.893µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.918µs | 3.920µs | 3.921µs | 0.22% | -0.670 | 8.208 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255061987.943op/s | 255595403.103op/s ± 193142.811op/s | 255620680.903op/s ± 103126.992op/s | 255721819.464op/s | 255813155.113op/s | 255846690.998op/s | 256856393.168op/s | 0.48% | 0.692 | 8.350 | 0.08% | 13657.259op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.180µs | 50.368µs ± 0.075µs | 50.372µs ± 0.052µs | 50.417µs | 50.494µs | 50.518µs | 50.583µs | 0.42% | 0.039 | -0.317 | 0.15% | 0.005µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19769379.754op/s | 19853747.668op/s ± 29490.413op/s | 19852283.053op/s ± 20623.772op/s | 19876238.950op/s | 19900553.548op/s | 19914505.184op/s | 19928318.140op/s | 0.38% | -0.031 | -0.320 | 0.15% | 2085.287op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.482µs | 45.663µs ± 0.103µs | 45.653µs ± 0.059µs | 45.716µs | 45.805µs | 46.039µs | 46.227µs | 1.26% | 1.594 | 6.013 | 0.23% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21632358.075op/s | 21899667.932op/s ± 49442.989op/s | 21904603.265op/s ± 28273.261op/s | 21931066.273op/s | 21966186.132op/s | 21983760.398op/s | 21986752.981op/s | 0.38% | -1.558 | 5.813 | 0.23% | 3496.147op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.427µs | 6.435µs ± 0.004µs | 6.434µs ± 0.003µs | 6.438µs | 6.442µs | 6.444µs | 6.445µs | 0.18% | 0.449 | -0.668 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 155155583.409op/s | 155407663.628op/s ± 106005.214op/s | 155427394.078op/s ± 73421.748op/s | 155488332.923op/s | 155557353.267op/s | 155587938.405op/s | 155597063.681op/s | 0.11% | -0.447 | -0.670 | 0.07% | 7495.701op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.912µs; 3.913µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255578156.547op/s; 255626019.618op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.681µs; 79.723µs] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12543410.193op/s; 12550054.725op/s] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.987µs; 68.016µs] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14702385.475op/s; 14708761.557op/s] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.912µs; 3.912µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255597831.445op/s; 255643784.159op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.761µs; 64.788µs] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15435015.724op/s; 15441312.795op/s] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.657µs; 45.683µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21889902.802op/s; 21902424.092op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.435µs; 6.436µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155377393.022op/s; 155410996.310op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.913µs; 3.914µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255510857.030op/s; 255563844.920op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.266µs; 65.292µs] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15315936.160op/s; 15322031.161op/s] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.883µs; 53.915µs] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18547760.104op/s; 18558853.915op/s] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255568635.367op/s; 255622170.839op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.358µs; 50.379µs] or [-0.021%; +0.021%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19849660.581op/s; 19857834.756op/s] or [-0.021%; +0.021%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.649µs; 45.677µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21892815.610op/s; 21906520.255op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.434µs; 6.435µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155392972.325op/s; 155422354.932op/s] or [-0.009%; +0.009%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.164µs | 34.812µs ± 1.088µs | 34.324µs ± 0.053µs | 34.375µs | 37.181µs | 37.213µs | 37.650µs | 9.69% | 1.693 | 0.908 | 3.12% | 0.077µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.661µs; 34.962µs] or [-0.433%; +0.433%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.453µs | 146.751µs ± 1.977µs | 146.410µs ± 0.530µs | 147.041µs | 148.682µs | 153.883µs | 167.941µs | 14.71% | 6.996 | 66.930 | 1.34% | 0.140µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.477µs; 147.025µs] or [-0.187%; +0.187%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.550ms | 49.757ms ± 0.674ms | 49.662ms ± 0.038ms | 49.695ms | 49.868ms | 53.285ms | 55.730ms | 12.22% | 7.776 | 62.216 | 1.35% | 0.048ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.664ms; 49.851ms] or [-0.188%; +0.188%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 14.001µs | 14.155µs ± 0.061µs | 14.167µs ± 0.033µs | 14.198µs | 14.230µs | 14.283µs | 14.335µs | 1.19% | -0.317 | 0.096 | 0.43% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [14.146µs; 14.163µs] or [-0.059%; +0.059%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.308µs | 2.387µs ± 0.019µs | 2.389µs ± 0.004µs | 2.393µs | 2.413µs | 2.419µs | 2.422µs | 1.38% | -2.123 | 5.688 | 0.81% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.384µs; 2.389µs] or [-0.112%; +0.112%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 742.278µs | 743.179µs ± 0.473µs | 743.139µs ± 0.259µs | 743.404µs | 743.966µs | 744.624µs | 745.407µs | 0.31% | 0.925 | 2.384 | 0.06% | 0.033µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [743.114µs; 743.245µs] or [-0.009%; +0.009%] | None | None | None |
Group 21
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | d743927 | 1774616738 | jwiriath/capability-traits-architecture |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | 899.582µs | 902.530µs ± 1.214µs | 902.511µs ± 0.831µs | 903.314µs | 904.467µs | 905.769µs | 906.718µs | 0.47% | 0.452 | 0.501 | 0.13% | 0.086µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_serialize_compressed_pprof_timestamped_x1000 | execution_time | [902.361µs; 902.698µs] or [-0.019%; +0.019%] | None | None | None |
Baseline
Omitted due to size.
16a302a to
78b3826
Compare
1084ae9 to
b03ced3
Compare
…iveCapabilities when specifying for native)
…le and don't really hinder awareness since we're in the ffi logic
… which is just plain better in those cases
… virality of annotation
…sm we can auto deduce it automagically
cbc7eaa to
090829b
Compare
090829b to
7c89dc5
Compare
What does this PR do?
Add capability trait architecture, and few native implementations.
Motivation
Ongoing effort to make libdatadog wasm compatible.
Additional Notes
In the long run, several other parts of the codebase ought to use these capabilities via the provided public structure, so that it can automagically choose the correct underlying implementation when compiling or not to wasm.
How to test the change?
I should add some tests...