Skip to content

Update SLOs#11007

Open
faydef wants to merge 1 commit intomasterfrom
fayssal/optimize-slos
Open

Update SLOs#11007
faydef wants to merge 1 commit intomasterfrom
fayssal/optimize-slos

Conversation

@faydef
Copy link
Copy Markdown

@faydef faydef commented Mar 31, 2026

What Does This Do

This PR updates SLOs that were identified as optimisable during OE review in February, 2026. PR sets SLOs at ca. 10% higher than SLIs collected from actual run, to make sure gates are not flaky, but still able to catch regression if it happens.

Motivation

These SLOs were set too loosely and thus would not catch potential regressions.
example
image

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@faydef faydef requested a review from a team as a code owner March 31, 2026 07:25
@faydef faydef requested review from pawelchcki and removed request for a team March 31, 2026 07:25
@github-actions
Copy link
Copy Markdown
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 31, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/optimize-slos
git_commit_date 1774925260 1774941660
git_commit_sha b7fb6fc d573ccf
release_version 1.61.0-SNAPSHOT~b7fb6fc123 1.61.0-SNAPSHOT~d573ccf220
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774943462 1774943462
ci_job_id 1553177210 1553177210
ci_pipeline_id 105194617 105194617
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zrjmhp5x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zrjmhp5x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061948
Total [baseline] (11.094 s) : 0, 11094383
Agent [candidate] (1.068 s) : 0, 1067936
Total [candidate] (11.125 s) : 0, 11124660
section appsec
Agent [baseline] (1.25 s) : 0, 1250203
Total [baseline] (11.136 s) : 0, 11136232
Agent [candidate] (1.254 s) : 0, 1253520
Total [candidate] (11.25 s) : 0, 11249677
section iast
Agent [baseline] (1.236 s) : 0, 1235711
Total [baseline] (11.386 s) : 0, 11385853
Agent [candidate] (1.234 s) : 0, 1233600
Total [candidate] (11.333 s) : 0, 11333243
section profiling
Agent [baseline] (1.194 s) : 0, 1194294
Total [baseline] (11.099 s) : 0, 11098539
Agent [candidate] (1.188 s) : 0, 1187682
Total [candidate] (11.045 s) : 0, 11044525
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.25 s 188.254 ms (17.7%)
Agent iast 1.236 s 173.762 ms (16.4%)
Agent profiling 1.194 s 132.346 ms (12.5%)
Total tracing 11.094 s -
Total appsec 11.136 s 41.848 ms (0.4%)
Total iast 11.386 s 291.47 ms (2.6%)
Total profiling 11.099 s 4.155 ms (0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.254 s 185.583 ms (17.4%)
Agent iast 1.234 s 165.664 ms (15.5%)
Agent profiling 1.188 s 119.746 ms (11.2%)
Total tracing 11.125 s -
Total appsec 11.25 s 125.017 ms (1.1%)
Total iast 11.333 s 208.583 ms (1.9%)
Total profiling 11.045 s -80.134 ms (-0.7%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (631.344 ms) : 0, 631344
BytebuddyAgent [candidate] (635.763 ms) : 0, 635763
AgentMeter [baseline] (29.429 ms) : 0, 29429
AgentMeter [candidate] (29.679 ms) : 0, 29679
GlobalTracer [baseline] (257.876 ms) : 0, 257876
GlobalTracer [candidate] (259.923 ms) : 0, 259923
AppSec [baseline] (31.811 ms) : 0, 31811
AppSec [candidate] (32.232 ms) : 0, 32232
Debugger [baseline] (60.543 ms) : 0, 60543
Debugger [candidate] (60.718 ms) : 0, 60718
Remote Config [baseline] (588.284 µs) : 0, 588
Remote Config [candidate] (602.045 µs) : 0, 602
Telemetry [baseline] (8.724 ms) : 0, 8724
Telemetry [candidate] (8.055 ms) : 0, 8055
Flare Poller [baseline] (4.26 ms) : 0, 4260
Flare Poller [candidate] (3.515 ms) : 0, 3515
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (659.749 ms) : 0, 659749
BytebuddyAgent [candidate] (662.286 ms) : 0, 662286
AgentMeter [baseline] (12.157 ms) : 0, 12157
AgentMeter [candidate] (12.171 ms) : 0, 12171
GlobalTracer [baseline] (258.656 ms) : 0, 258656
GlobalTracer [candidate] (259.232 ms) : 0, 259232
AppSec [baseline] (178.495 ms) : 0, 178495
AppSec [candidate] (178.253 ms) : 0, 178253
Debugger [baseline] (66.696 ms) : 0, 66696
Debugger [candidate] (66.767 ms) : 0, 66767
Remote Config [baseline] (640.766 µs) : 0, 641
Remote Config [candidate] (635.808 µs) : 0, 636
Telemetry [baseline] (8.331 ms) : 0, 8331
Telemetry [candidate] (8.52 ms) : 0, 8520
Flare Poller [baseline] (3.642 ms) : 0, 3642
Flare Poller [candidate] (3.667 ms) : 0, 3667
IAST [baseline] (24.304 ms) : 0, 24304
IAST [candidate] (24.268 ms) : 0, 24268
section iast
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (801.365 ms) : 0, 801365
BytebuddyAgent [candidate] (800.861 ms) : 0, 800861
AgentMeter [baseline] (11.479 ms) : 0, 11479
AgentMeter [candidate] (11.443 ms) : 0, 11443
GlobalTracer [baseline] (248.984 ms) : 0, 248984
GlobalTracer [candidate] (248.757 ms) : 0, 248757
AppSec [baseline] (26.62 ms) : 0, 26620
AppSec [candidate] (26.681 ms) : 0, 26681
Debugger [baseline] (70.344 ms) : 0, 70344
Debugger [candidate] (69.303 ms) : 0, 69303
Remote Config [baseline] (540.586 µs) : 0, 541
Remote Config [candidate] (524.74 µs) : 0, 525
Telemetry [baseline] (9.836 ms) : 0, 9836
Telemetry [candidate] (9.662 ms) : 0, 9662
Flare Poller [baseline] (3.623 ms) : 0, 3623
Flare Poller [candidate] (3.562 ms) : 0, 3562
IAST [baseline] (25.439 ms) : 0, 25439
IAST [candidate] (25.453 ms) : 0, 25453
section profiling
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (690.286 ms) : 0, 690286
BytebuddyAgent [candidate] (686.096 ms) : 0, 686096
AgentMeter [baseline] (8.979 ms) : 0, 8979
AgentMeter [candidate] (8.979 ms) : 0, 8979
GlobalTracer [baseline] (216.662 ms) : 0, 216662
GlobalTracer [candidate] (215.609 ms) : 0, 215609
AppSec [baseline] (32.597 ms) : 0, 32597
AppSec [candidate] (32.49 ms) : 0, 32490
Debugger [baseline] (66.919 ms) : 0, 66919
Debugger [candidate] (66.217 ms) : 0, 66217
Remote Config [baseline] (580.812 µs) : 0, 581
Remote Config [candidate] (577.845 µs) : 0, 578
Telemetry [baseline] (7.843 ms) : 0, 7843
Telemetry [candidate] (7.772 ms) : 0, 7772
Flare Poller [baseline] (3.585 ms) : 0, 3585
Flare Poller [candidate] (3.496 ms) : 0, 3496
ProfilingAgent [baseline] (94.528 ms) : 0, 94528
ProfilingAgent [candidate] (94.019 ms) : 0, 94019
Profiling [baseline] (95.079 ms) : 0, 95079
Profiling [candidate] (94.573 ms) : 0, 94573
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059366
Total [baseline] (8.877 s) : 0, 8876982
Agent [candidate] (1.061 s) : 0, 1060911
Total [candidate] (8.844 s) : 0, 8843976
section iast
Agent [baseline] (1.236 s) : 0, 1235619
Total [baseline] (9.61 s) : 0, 9609973
Agent [candidate] (1.231 s) : 0, 1231043
Total [candidate] (9.61 s) : 0, 9609901
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.236 s 176.253 ms (16.6%)
Total tracing 8.877 s -
Total iast 9.61 s 732.99 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.231 s 170.132 ms (16.0%)
Total tracing 8.844 s -
Total iast 9.61 s 765.926 ms (8.7%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (631.272 ms) : 0, 631272
BytebuddyAgent [candidate] (631.183 ms) : 0, 631183
AgentMeter [baseline] (29.448 ms) : 0, 29448
AgentMeter [candidate] (29.425 ms) : 0, 29425
GlobalTracer [baseline] (257.704 ms) : 0, 257704
GlobalTracer [candidate] (258.183 ms) : 0, 258183
AppSec [baseline] (31.9 ms) : 0, 31900
AppSec [candidate] (31.918 ms) : 0, 31918
Debugger [baseline] (59.532 ms) : 0, 59532
Debugger [candidate] (59.849 ms) : 0, 59849
Remote Config [baseline] (616.536 µs) : 0, 617
Remote Config [candidate] (610.348 µs) : 0, 610
Telemetry [baseline] (8.057 ms) : 0, 8057
Telemetry [candidate] (8.055 ms) : 0, 8055
Flare Poller [baseline] (3.572 ms) : 0, 3572
Flare Poller [candidate] (4.272 ms) : 0, 4272
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (800.951 ms) : 0, 800951
BytebuddyAgent [candidate] (799.638 ms) : 0, 799638
AgentMeter [baseline] (11.571 ms) : 0, 11571
AgentMeter [candidate] (11.416 ms) : 0, 11416
GlobalTracer [baseline] (249.813 ms) : 0, 249813
GlobalTracer [candidate] (248.139 ms) : 0, 248139
AppSec [baseline] (26.785 ms) : 0, 26785
AppSec [candidate] (26.648 ms) : 0, 26648
Debugger [baseline] (69.537 ms) : 0, 69537
Debugger [candidate] (68.849 ms) : 0, 68849
Remote Config [baseline] (536.988 µs) : 0, 537
Remote Config [candidate] (519.973 µs) : 0, 520
Telemetry [baseline] (9.691 ms) : 0, 9691
Telemetry [candidate] (9.646 ms) : 0, 9646
Flare Poller [baseline] (3.613 ms) : 0, 3613
Flare Poller [candidate] (3.572 ms) : 0, 3572
IAST [baseline] (25.665 ms) : 0, 25665
IAST [candidate] (25.365 ms) : 0, 25365
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/optimize-slos
git_commit_date 1774925260 1774941660
git_commit_sha b7fb6fc d573ccf
release_version 1.61.0-SNAPSHOT~b7fb6fc123 1.61.0-SNAPSHOT~d573ccf220
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774943938 1774943938
ci_job_id 1553177211 1553177211
ci_pipeline_id 105194617 105194617
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-n84zhpxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-n84zhpxf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load worse
[+0.804ms; +1.592ms] or [+4.601%; +9.112%]
worse
[+0.798ms; +2.207ms] or [+2.801%; +7.750%]
unstable
[-40.111op/s; +9.986op/s] or [-15.335%; +3.818%]
18.672ms 29.981ms 246.500op/s 17.474ms 28.478ms 261.562op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.818 ms) : 18622, 19014
.   : milestone, 18818,
appsec (18.747 ms) : 18558, 18937
.   : milestone, 18747,
code_origins (17.973 ms) : 17795, 18152
.   : milestone, 17973,
iast (17.838 ms) : 17663, 18012
.   : milestone, 17838,
profiling (18.838 ms) : 18649, 19027
.   : milestone, 18838,
tracing (18.249 ms) : 18066, 18431
.   : milestone, 18249,
section candidate
no_agent (19.183 ms) : 18989, 19378
.   : milestone, 19183,
appsec (18.788 ms) : 18597, 18978
.   : milestone, 18788,
code_origins (17.892 ms) : 17717, 18067
.   : milestone, 17892,
iast (18.932 ms) : 18743, 19120
.   : milestone, 18932,
profiling (18.811 ms) : 18626, 18996
.   : milestone, 18811,
tracing (17.926 ms) : 17750, 18102
.   : milestone, 17926,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.818 ms [18.622 ms, 19.014 ms] -
appsec 18.747 ms [18.558 ms, 18.937 ms] -70.87 µs (-0.4%)
code_origins 17.973 ms [17.795 ms, 18.152 ms] -844.772 µs (-4.5%)
iast 17.838 ms [17.663 ms, 18.012 ms] -980.561 µs (-5.2%)
profiling 18.838 ms [18.649 ms, 19.027 ms] 19.987 µs (0.1%)
tracing 18.249 ms [18.066 ms, 18.431 ms] -569.709 µs (-3.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.183 ms [18.989 ms, 19.378 ms] -
appsec 18.788 ms [18.597 ms, 18.978 ms] -395.756 µs (-2.1%)
code_origins 17.892 ms [17.717 ms, 18.067 ms] -1.291 ms (-6.7%)
iast 18.932 ms [18.743 ms, 19.12 ms] -251.652 µs (-1.3%)
profiling 18.811 ms [18.626 ms, 18.996 ms] -372.107 µs (-1.9%)
tracing 17.926 ms [17.75 ms, 18.102 ms] -1.257 ms (-6.6%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.232 ms) : 1220, 1244
.   : milestone, 1232,
iast (3.199 ms) : 3156, 3241
.   : milestone, 3199,
iast_FULL (5.955 ms) : 5895, 6015
.   : milestone, 5955,
iast_GLOBAL (3.698 ms) : 3638, 3759
.   : milestone, 3698,
profiling (2.456 ms) : 2431, 2480
.   : milestone, 2456,
tracing (1.851 ms) : 1836, 1866
.   : milestone, 1851,
section candidate
no_agent (1.22 ms) : 1208, 1232
.   : milestone, 1220,
iast (3.146 ms) : 3102, 3189
.   : milestone, 3146,
iast_FULL (5.96 ms) : 5899, 6020
.   : milestone, 5960,
iast_GLOBAL (3.788 ms) : 3732, 3844
.   : milestone, 3788,
profiling (2.29 ms) : 2267, 2312
.   : milestone, 2290,
tracing (1.882 ms) : 1863, 1900
.   : milestone, 1882,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.232 ms [1.22 ms, 1.244 ms] -
iast 3.199 ms [3.156 ms, 3.241 ms] 1.967 ms (159.6%)
iast_FULL 5.955 ms [5.895 ms, 6.015 ms] 4.723 ms (383.3%)
iast_GLOBAL 3.698 ms [3.638 ms, 3.759 ms] 2.466 ms (200.2%)
profiling 2.456 ms [2.431 ms, 2.48 ms] 1.224 ms (99.3%)
tracing 1.851 ms [1.836 ms, 1.866 ms] 618.566 µs (50.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.22 ms [1.208 ms, 1.232 ms] -
iast 3.146 ms [3.102 ms, 3.189 ms] 1.926 ms (157.8%)
iast_FULL 5.96 ms [5.899 ms, 6.02 ms] 4.739 ms (388.5%)
iast_GLOBAL 3.788 ms [3.732 ms, 3.844 ms] 2.568 ms (210.5%)
profiling 2.29 ms [2.267 ms, 2.312 ms] 1.069 ms (87.7%)
tracing 1.882 ms [1.863 ms, 1.9 ms] 661.464 µs (54.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master fayssal/optimize-slos
git_commit_date 1774925260 1774941660
git_commit_sha b7fb6fc d573ccf
release_version 1.61.0-SNAPSHOT~b7fb6fc123 1.61.0-SNAPSHOT~d573ccf220
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774943728 1774943728
ci_job_id 1553177212 1553177212
ci_pipeline_id 105194617 105194617
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-yh055rqr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-yh055rqr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
appsec (15.238 s) : 15238000, 15238000
.   : milestone, 15238000,
iast (18.382 s) : 18382000, 18382000
.   : milestone, 18382000,
iast_GLOBAL (17.771 s) : 17771000, 17771000
.   : milestone, 17771000,
profiling (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
tracing (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
section candidate
no_agent (15.423 s) : 15423000, 15423000
.   : milestone, 15423000,
appsec (14.798 s) : 14798000, 14798000
.   : milestone, 14798000,
iast (18.281 s) : 18281000, 18281000
.   : milestone, 18281000,
iast_GLOBAL (18.156 s) : 18156000, 18156000
.   : milestone, 18156000,
profiling (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
tracing (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.012 s [15.012 s, 15.012 s] -
appsec 15.238 s [15.238 s, 15.238 s] 226.0 ms (1.5%)
iast 18.382 s [18.382 s, 18.382 s] 3.37 s (22.4%)
iast_GLOBAL 17.771 s [17.771 s, 17.771 s] 2.759 s (18.4%)
profiling 14.939 s [14.939 s, 14.939 s] -73.0 ms (-0.5%)
tracing 14.822 s [14.822 s, 14.822 s] -190.0 ms (-1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.423 s [15.423 s, 15.423 s] -
appsec 14.798 s [14.798 s, 14.798 s] -625.0 ms (-4.1%)
iast 18.281 s [18.281 s, 18.281 s] 2.858 s (18.5%)
iast_GLOBAL 18.156 s [18.156 s, 18.156 s] 2.733 s (17.7%)
profiling 15.138 s [15.138 s, 15.138 s] -285.0 ms (-1.8%)
tracing 15.006 s [15.006 s, 15.006 s] -417.0 ms (-2.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d573ccf220, baseline=1.61.0-SNAPSHOT~b7fb6fc123
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (3.829 ms) : 3606, 4052
.   : milestone, 3829,
iast (2.282 ms) : 2213, 2351
.   : milestone, 2282,
iast_GLOBAL (2.314 ms) : 2244, 2385
.   : milestone, 2314,
profiling (2.105 ms) : 2049, 2161
.   : milestone, 2105,
tracing (2.08 ms) : 2027, 2134
.   : milestone, 2080,
section candidate
no_agent (1.485 ms) : 1474, 1497
.   : milestone, 1485,
appsec (3.753 ms) : 3536, 3969
.   : milestone, 3753,
iast (2.275 ms) : 2206, 2344
.   : milestone, 2275,
iast_GLOBAL (2.312 ms) : 2243, 2382
.   : milestone, 2312,
profiling (2.129 ms) : 2072, 2186
.   : milestone, 2129,
tracing (2.084 ms) : 2030, 2138
.   : milestone, 2084,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 3.829 ms [3.606 ms, 4.052 ms] 2.345 ms (157.9%)
iast 2.282 ms [2.213 ms, 2.351 ms] 797.232 µs (53.7%)
iast_GLOBAL 2.314 ms [2.244 ms, 2.385 ms] 829.684 µs (55.9%)
profiling 2.105 ms [2.049 ms, 2.161 ms] 620.399 µs (41.8%)
tracing 2.08 ms [2.027 ms, 2.134 ms] 595.664 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.474 ms, 1.497 ms] -
appsec 3.753 ms [3.536 ms, 3.969 ms] 2.267 ms (152.6%)
iast 2.275 ms [2.206 ms, 2.344 ms] 789.318 µs (53.1%)
iast_GLOBAL 2.312 ms [2.243 ms, 2.382 ms] 827.016 µs (55.7%)
profiling 2.129 ms [2.072 ms, 2.186 ms] 643.519 µs (43.3%)
tracing 2.084 ms [2.03 ms, 2.138 ms] 598.468 µs (40.3%)

@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 31, 2026
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good. cc @bric3 for benchmark review

@faydef
Copy link
Copy Markdown
Author

faydef commented Mar 31, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 bot commented Mar 31, 2026

View all feedbacks in Devflow UI.

2026-03-31 12:21:38 UTC ℹ️ Start processing command /merge
Use /merge -c to cancel this operation!


2026-03-31 12:21:43 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

Use /merge -c to cancel this operation!


2026-03-31 13:18:38 UTC ℹ️ MergeQueue: Readding this merge request to the queue because another merge request processed with yours failed. No action is needed from your side.
Use /merge -c to cancel this operation!


⏳ Processing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants