Skip to content

Update smoke test latest tool versions#10993

Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260329
Closed

Update smoke test latest tool versions#10993
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
ci/update-smoke-test-latest-versions-20260329

Conversation

@dd-octo-sts
Copy link
Copy Markdown
Contributor

@dd-octo-sts dd-octo-sts bot commented Mar 29, 2026

What Does This Do

This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:

  • Gradle: 9.4.1
  • Maven: 3.9.14
  • Maven Surefire: 3.5.5

Motivation

Keep smoke tests running against the latest stable versions of build tools.

Contributor Checklist

  • Verify smoke tests pass with the new versions

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts dd-octo-sts bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 29, 2026
@dd-octo-sts dd-octo-sts bot requested a review from a team as a code owner March 29, 2026 05:37
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 29, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260329
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774764513 1774764513
ci_job_id 1548330611 1548330611
ci_pipeline_id 104926305 104926305
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1774632959 1774632959
git_commit_sha a1239d3 a1239d3
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mpjxs66y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mpjxs66y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
release_version 1.61.0-SNAPSHOT~a1239d32d8 1.61.0-SNAPSHOT~a1239d32d8

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061758
Total [baseline] (10.979 s) : 0, 10978546
Agent [candidate] (1.064 s) : 0, 1064152
Total [candidate] (11.031 s) : 0, 11031378
section appsec
Agent [baseline] (1.247 s) : 0, 1246912
Total [baseline] (11.067 s) : 0, 11066551
Agent [candidate] (1.253 s) : 0, 1253471
Total [candidate] (11.097 s) : 0, 11097340
section iast
Agent [baseline] (1.231 s) : 0, 1231081
Total [baseline] (11.24 s) : 0, 11240114
Agent [candidate] (1.258 s) : 0, 1258256
Total [candidate] (11.363 s) : 0, 11363214
section profiling
Agent [baseline] (1.191 s) : 0, 1190511
Total [baseline] (10.96 s) : 0, 10960027
Agent [candidate] (1.181 s) : 0, 1180924
Total [candidate] (10.971 s) : 0, 10971167
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.247 s 185.154 ms (17.4%)
Agent iast 1.231 s 169.323 ms (15.9%)
Agent profiling 1.191 s 128.753 ms (12.1%)
Total tracing 10.979 s -
Total appsec 11.067 s 88.005 ms (0.8%)
Total iast 11.24 s 261.568 ms (2.4%)
Total profiling 10.96 s -18.519 ms (-0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.253 s 189.32 ms (17.8%)
Agent iast 1.258 s 194.105 ms (18.2%)
Agent profiling 1.181 s 116.772 ms (11.0%)
Total tracing 11.031 s -
Total appsec 11.097 s 65.962 ms (0.6%)
Total iast 11.363 s 331.836 ms (3.0%)
Total profiling 10.971 s -60.211 ms (-0.5%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (632.156 ms) : 0, 632156
BytebuddyAgent [candidate] (633.631 ms) : 0, 633631
AgentMeter [baseline] (29.571 ms) : 0, 29571
AgentMeter [candidate] (29.546 ms) : 0, 29546
GlobalTracer [baseline] (257.344 ms) : 0, 257344
GlobalTracer [candidate] (258.16 ms) : 0, 258160
AppSec [baseline] (31.907 ms) : 0, 31907
AppSec [candidate] (31.972 ms) : 0, 31972
Debugger [baseline] (60.514 ms) : 0, 60514
Debugger [candidate] (60.652 ms) : 0, 60652
Remote Config [baseline] (587.522 µs) : 0, 588
Remote Config [candidate] (587.352 µs) : 0, 587
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (8.795 ms) : 0, 8795
Flare Poller [baseline] (3.546 ms) : 0, 3546
Flare Poller [candidate] (3.571 ms) : 0, 3571
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (658.218 ms) : 0, 658218
BytebuddyAgent [candidate] (663.229 ms) : 0, 663229
AgentMeter [baseline] (12.189 ms) : 0, 12189
AgentMeter [candidate] (12.227 ms) : 0, 12227
GlobalTracer [baseline] (258.006 ms) : 0, 258006
GlobalTracer [candidate] (258.699 ms) : 0, 258699
IAST [baseline] (24.177 ms) : 0, 24177
IAST [candidate] (24.278 ms) : 0, 24278
AppSec [baseline] (178.001 ms) : 0, 178001
AppSec [candidate] (178.069 ms) : 0, 178069
Debugger [baseline] (66.55 ms) : 0, 66550
Debugger [candidate] (66.67 ms) : 0, 66670
Remote Config [baseline] (624.589 µs) : 0, 625
Remote Config [candidate] (644.619 µs) : 0, 645
Telemetry [baseline] (8.225 ms) : 0, 8225
Telemetry [candidate] (8.44 ms) : 0, 8440
Flare Poller [baseline] (3.543 ms) : 0, 3543
Flare Poller [candidate] (3.643 ms) : 0, 3643
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (799.038 ms) : 0, 799038
BytebuddyAgent [candidate] (818.804 ms) : 0, 818804
AgentMeter [baseline] (11.454 ms) : 0, 11454
AgentMeter [candidate] (12.348 ms) : 0, 12348
GlobalTracer [baseline] (247.276 ms) : 0, 247276
GlobalTracer [candidate] (251.468 ms) : 0, 251468
IAST [baseline] (25.398 ms) : 0, 25398
IAST [candidate] (26.114 ms) : 0, 26114
AppSec [baseline] (26.666 ms) : 0, 26666
AppSec [candidate] (27.433 ms) : 0, 27433
Debugger [baseline] (70.707 ms) : 0, 70707
Debugger [candidate] (71.163 ms) : 0, 71163
Remote Config [baseline] (529.782 µs) : 0, 530
Remote Config [candidate] (525.203 µs) : 0, 525
Telemetry [baseline] (9.202 ms) : 0, 9202
Telemetry [candidate] (9.182 ms) : 0, 9182
Flare Poller [baseline] (3.405 ms) : 0, 3405
Flare Poller [candidate] (3.446 ms) : 0, 3446
section profiling
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.167 ms) : 0, 1167
BytebuddyAgent [baseline] (688.908 ms) : 0, 688908
BytebuddyAgent [candidate] (682.306 ms) : 0, 682306
AgentMeter [baseline] (9.046 ms) : 0, 9046
AgentMeter [candidate] (8.931 ms) : 0, 8931
GlobalTracer [baseline] (215.752 ms) : 0, 215752
GlobalTracer [candidate] (214.488 ms) : 0, 214488
AppSec [baseline] (32.407 ms) : 0, 32407
AppSec [candidate] (32.189 ms) : 0, 32189
Debugger [baseline] (65.534 ms) : 0, 65534
Debugger [candidate] (65.764 ms) : 0, 65764
Remote Config [baseline] (566.49 µs) : 0, 566
Remote Config [candidate] (557.462 µs) : 0, 557
Telemetry [baseline] (7.72 ms) : 0, 7720
Telemetry [candidate] (7.731 ms) : 0, 7731
Flare Poller [baseline] (4.218 ms) : 0, 4218
Flare Poller [candidate] (3.47 ms) : 0, 3470
ProfilingAgent [baseline] (93.781 ms) : 0, 93781
ProfilingAgent [candidate] (93.614 ms) : 0, 93614
Profiling [baseline] (94.34 ms) : 0, 94340
Profiling [candidate] (94.17 ms) : 0, 94170
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054021
Total [baseline] (8.843 s) : 0, 8842546
Agent [candidate] (1.063 s) : 0, 1062920
Total [candidate] (8.845 s) : 0, 8845231
section iast
Agent [baseline] (1.245 s) : 0, 1245015
Total [baseline] (9.596 s) : 0, 9596354
Agent [candidate] (1.23 s) : 0, 1229536
Total [candidate] (9.541 s) : 0, 9541175
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.245 s 190.994 ms (18.1%)
Total tracing 8.843 s -
Total iast 9.596 s 753.808 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.23 s 166.615 ms (15.7%)
Total tracing 8.845 s -
Total iast 9.541 s 695.944 ms (7.9%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (627.987 ms) : 0, 627987
BytebuddyAgent [candidate] (633.572 ms) : 0, 633572
AgentMeter [baseline] (29.273 ms) : 0, 29273
AgentMeter [candidate] (29.501 ms) : 0, 29501
GlobalTracer [baseline] (256.017 ms) : 0, 256017
GlobalTracer [candidate] (257.658 ms) : 0, 257658
AppSec [baseline] (31.62 ms) : 0, 31620
AppSec [candidate] (31.91 ms) : 0, 31910
Debugger [baseline] (59.208 ms) : 0, 59208
Debugger [candidate] (59.98 ms) : 0, 59980
Remote Config [baseline] (581.292 µs) : 0, 581
Remote Config [candidate] (587.255 µs) : 0, 587
Telemetry [baseline] (8.01 ms) : 0, 8010
Telemetry [candidate] (8.027 ms) : 0, 8027
Flare Poller [baseline] (4.214 ms) : 0, 4214
Flare Poller [candidate] (4.32 ms) : 0, 4320
section iast
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (809.76 ms) : 0, 809760
BytebuddyAgent [candidate] (798.145 ms) : 0, 798145
AgentMeter [baseline] (11.679 ms) : 0, 11679
AgentMeter [candidate] (11.408 ms) : 0, 11408
GlobalTracer [baseline] (249.611 ms) : 0, 249611
GlobalTracer [candidate] (247.28 ms) : 0, 247280
IAST [baseline] (25.718 ms) : 0, 25718
IAST [candidate] (25.382 ms) : 0, 25382
AppSec [baseline] (27.741 ms) : 0, 27741
AppSec [candidate] (26.54 ms) : 0, 26540
Debugger [baseline] (67.706 ms) : 0, 67706
Debugger [candidate] (68.285 ms) : 0, 68285
Remote Config [baseline] (532.454 µs) : 0, 532
Remote Config [candidate] (529.208 µs) : 0, 529
Telemetry [baseline] (11.124 ms) : 0, 11124
Telemetry [candidate] (10.811 ms) : 0, 10811
Flare Poller [baseline] (3.536 ms) : 0, 3536
Flare Poller [candidate] (3.873 ms) : 0, 3873
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260329
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774765004 1774765004
ci_job_id 1548330613 1548330613
ci_pipeline_id 104926305 104926305
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1774632959 1774632959
git_commit_sha a1239d3 a1239d3
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-gd4qfa9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-gd4qfa9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0-SNAPSHOT~a1239d32d8 1.61.0-SNAPSHOT~a1239d32d8

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+157.934µs; +267.770µs] or [+5.917%; +10.031%]
worse
[+245.187µs; +700.736µs] or [+3.232%; +9.237%]
unstable
[-188.119op/s; +58.744op/s] or [-14.113%; +4.407%]
2.882ms 8.059ms 1268.250op/s 2.669ms 7.586ms 1332.938op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+108.942µs; +324.339µs] or [+2.118%; +6.305%]
unsure
[+201.101µs; +887.230µs] or [+1.635%; +7.215%]
unstable
[-108.039op/s; +39.789op/s] or [-13.475%; +4.963%]
5.360ms 12.841ms 767.625op/s 5.144ms 12.297ms 801.750op/s
scenario:load:petclinic:profiling:high_load worse
[+0.627ms; +1.681ms] or [+3.398%; +9.100%]
unsure
[+0.483ms; +1.877ms] or [+1.610%; +6.256%]
unstable
[-37.529op/s; +17.467op/s] or [-15.206%; +7.077%]
19.621ms 31.185ms 236.781op/s 18.467ms 30.005ms 246.812op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.129 ms) : 18932, 19325
.   : milestone, 19129,
appsec (18.562 ms) : 18377, 18747
.   : milestone, 18562,
code_origins (17.694 ms) : 17517, 17870
.   : milestone, 17694,
iast (17.623 ms) : 17445, 17801
.   : milestone, 17623,
profiling (18.913 ms) : 18726, 19100
.   : milestone, 18913,
tracing (17.804 ms) : 17630, 17978
.   : milestone, 17804,
section candidate
no_agent (19.092 ms) : 18898, 19287
.   : milestone, 19092,
appsec (18.444 ms) : 18257, 18631
.   : milestone, 18444,
code_origins (17.993 ms) : 17810, 18175
.   : milestone, 17993,
iast (18.058 ms) : 17879, 18237
.   : milestone, 18058,
profiling (19.713 ms) : 19515, 19911
.   : milestone, 19713,
tracing (18.062 ms) : 17882, 18242
.   : milestone, 18062,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.129 ms [18.932 ms, 19.325 ms] -
appsec 18.562 ms [18.377 ms, 18.747 ms] -566.402 µs (-3.0%)
code_origins 17.694 ms [17.517 ms, 17.87 ms] -1.435 ms (-7.5%)
iast 17.623 ms [17.445 ms, 17.801 ms] -1.505 ms (-7.9%)
profiling 18.913 ms [18.726 ms, 19.1 ms] -215.933 µs (-1.1%)
tracing 17.804 ms [17.63 ms, 17.978 ms] -1.325 ms (-6.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.092 ms [18.898 ms, 19.287 ms] -
appsec 18.444 ms [18.257 ms, 18.631 ms] -648.224 µs (-3.4%)
code_origins 17.993 ms [17.81 ms, 18.175 ms] -1.1 ms (-5.8%)
iast 18.058 ms [17.879 ms, 18.237 ms] -1.034 ms (-5.4%)
profiling 19.713 ms [19.515 ms, 19.911 ms] 620.616 µs (3.3%)
tracing 18.062 ms [17.882 ms, 18.242 ms] -1.03 ms (-5.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.171 ms) : 1159, 1182
.   : milestone, 1171,
iast (3.272 ms) : 3225, 3320
.   : milestone, 3272,
iast_FULL (5.768 ms) : 5711, 5825
.   : milestone, 5768,
iast_GLOBAL (3.438 ms) : 3380, 3496
.   : milestone, 3438,
profiling (1.999 ms) : 1981, 2017
.   : milestone, 1999,
tracing (1.772 ms) : 1757, 1787
.   : milestone, 1772,
section candidate
no_agent (1.245 ms) : 1233, 1258
.   : milestone, 1245,
iast (3.231 ms) : 3188, 3274
.   : milestone, 3231,
iast_FULL (6.024 ms) : 5962, 6086
.   : milestone, 6024,
iast_GLOBAL (3.617 ms) : 3563, 3671
.   : milestone, 3617,
profiling (2.071 ms) : 2052, 2090
.   : milestone, 2071,
tracing (1.774 ms) : 1760, 1789
.   : milestone, 1774,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.171 ms [1.159 ms, 1.182 ms] -
iast 3.272 ms [3.225 ms, 3.32 ms] 2.102 ms (179.5%)
iast_FULL 5.768 ms [5.711 ms, 5.825 ms] 4.597 ms (392.6%)
iast_GLOBAL 3.438 ms [3.38 ms, 3.496 ms] 2.267 ms (193.6%)
profiling 1.999 ms [1.981 ms, 2.017 ms] 828.297 µs (70.7%)
tracing 1.772 ms [1.757 ms, 1.787 ms] 601.49 µs (51.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.245 ms [1.233 ms, 1.258 ms] -
iast 3.231 ms [3.188 ms, 3.274 ms] 1.986 ms (159.5%)
iast_FULL 6.024 ms [5.962 ms, 6.086 ms] 4.779 ms (383.8%)
iast_GLOBAL 3.617 ms [3.563 ms, 3.671 ms] 2.372 ms (190.5%)
profiling 2.071 ms [2.052 ms, 2.09 ms] 825.832 µs (66.3%)
tracing 1.774 ms [1.76 ms, 1.789 ms] 529.284 µs (42.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-smoke-test-latest-versions-20260329
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774764924 1774764924
ci_job_id 1548330615 1548330615
ci_pipeline_id 104926305 104926305
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1774632959 1774632959
git_commit_sha a1239d3 a1239d3
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-xg9jcehy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-xg9jcehy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
release_version 1.61.0-SNAPSHOT~a1239d32d8 1.61.0-SNAPSHOT~a1239d32d8

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.817 ms) : 3595, 4039
.   : milestone, 3817,
iast (2.259 ms) : 2190, 2329
.   : milestone, 2259,
iast_GLOBAL (2.295 ms) : 2225, 2364
.   : milestone, 2295,
profiling (2.095 ms) : 2039, 2152
.   : milestone, 2095,
tracing (2.067 ms) : 2013, 2120
.   : milestone, 2067,
section candidate
no_agent (1.474 ms) : 1462, 1486
.   : milestone, 1474,
appsec (3.824 ms) : 3596, 4053
.   : milestone, 3824,
iast (2.251 ms) : 2182, 2321
.   : milestone, 2251,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.114 ms) : 2057, 2171
.   : milestone, 2114,
tracing (2.073 ms) : 2019, 2127
.   : milestone, 2073,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.817 ms [3.595 ms, 4.039 ms] 2.345 ms (159.4%)
iast 2.259 ms [2.19 ms, 2.329 ms] 787.985 µs (53.6%)
iast_GLOBAL 2.295 ms [2.225 ms, 2.364 ms] 823.137 µs (55.9%)
profiling 2.095 ms [2.039 ms, 2.152 ms] 623.974 µs (42.4%)
tracing 2.067 ms [2.013 ms, 2.12 ms] 595.515 µs (40.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.486 ms] -
appsec 3.824 ms [3.596 ms, 4.053 ms] 2.35 ms (159.4%)
iast 2.251 ms [2.182 ms, 2.321 ms] 777.39 µs (52.7%)
iast_GLOBAL 2.303 ms [2.233 ms, 2.372 ms] 828.534 µs (56.2%)
profiling 2.114 ms [2.057 ms, 2.171 ms] 639.923 µs (43.4%)
tracing 2.073 ms [2.019 ms, 2.127 ms] 599.09 µs (40.6%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.501 s) : 15501000, 15501000
.   : milestone, 15501000,
appsec (14.662 s) : 14662000, 14662000
.   : milestone, 14662000,
iast (18.021 s) : 18021000, 18021000
.   : milestone, 18021000,
iast_GLOBAL (17.704 s) : 17704000, 17704000
.   : milestone, 17704000,
profiling (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
tracing (14.907 s) : 14907000, 14907000
.   : milestone, 14907000,
section candidate
no_agent (15.634 s) : 15634000, 15634000
.   : milestone, 15634000,
appsec (14.828 s) : 14828000, 14828000
.   : milestone, 14828000,
iast (18.276 s) : 18276000, 18276000
.   : milestone, 18276000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.228 s) : 15228000, 15228000
.   : milestone, 15228000,
tracing (15.109 s) : 15109000, 15109000
.   : milestone, 15109000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.501 s [15.501 s, 15.501 s] -
appsec 14.662 s [14.662 s, 14.662 s] -839.0 ms (-5.4%)
iast 18.021 s [18.021 s, 18.021 s] 2.52 s (16.3%)
iast_GLOBAL 17.704 s [17.704 s, 17.704 s] 2.203 s (14.2%)
profiling 14.979 s [14.979 s, 14.979 s] -522.0 ms (-3.4%)
tracing 14.907 s [14.907 s, 14.907 s] -594.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.634 s [15.634 s, 15.634 s] -
appsec 14.828 s [14.828 s, 14.828 s] -806.0 ms (-5.2%)
iast 18.276 s [18.276 s, 18.276 s] 2.642 s (16.9%)
iast_GLOBAL 17.938 s [17.938 s, 17.938 s] 2.304 s (14.7%)
profiling 15.228 s [15.228 s, 15.228 s] -406.0 ms (-2.6%)
tracing 15.109 s [15.109 s, 15.109 s] -525.0 ms (-3.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant