Update smoke test latest tool versions#10993
Closed
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
Closed
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061758
Total [baseline] (10.979 s) : 0, 10978546
Agent [candidate] (1.064 s) : 0, 1064152
Total [candidate] (11.031 s) : 0, 11031378
section appsec
Agent [baseline] (1.247 s) : 0, 1246912
Total [baseline] (11.067 s) : 0, 11066551
Agent [candidate] (1.253 s) : 0, 1253471
Total [candidate] (11.097 s) : 0, 11097340
section iast
Agent [baseline] (1.231 s) : 0, 1231081
Total [baseline] (11.24 s) : 0, 11240114
Agent [candidate] (1.258 s) : 0, 1258256
Total [candidate] (11.363 s) : 0, 11363214
section profiling
Agent [baseline] (1.191 s) : 0, 1190511
Total [baseline] (10.96 s) : 0, 10960027
Agent [candidate] (1.181 s) : 0, 1180924
Total [candidate] (10.971 s) : 0, 10971167
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (632.156 ms) : 0, 632156
BytebuddyAgent [candidate] (633.631 ms) : 0, 633631
AgentMeter [baseline] (29.571 ms) : 0, 29571
AgentMeter [candidate] (29.546 ms) : 0, 29546
GlobalTracer [baseline] (257.344 ms) : 0, 257344
GlobalTracer [candidate] (258.16 ms) : 0, 258160
AppSec [baseline] (31.907 ms) : 0, 31907
AppSec [candidate] (31.972 ms) : 0, 31972
Debugger [baseline] (60.514 ms) : 0, 60514
Debugger [candidate] (60.652 ms) : 0, 60652
Remote Config [baseline] (587.522 µs) : 0, 588
Remote Config [candidate] (587.352 µs) : 0, 587
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (8.795 ms) : 0, 8795
Flare Poller [baseline] (3.546 ms) : 0, 3546
Flare Poller [candidate] (3.571 ms) : 0, 3571
section appsec
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (658.218 ms) : 0, 658218
BytebuddyAgent [candidate] (663.229 ms) : 0, 663229
AgentMeter [baseline] (12.189 ms) : 0, 12189
AgentMeter [candidate] (12.227 ms) : 0, 12227
GlobalTracer [baseline] (258.006 ms) : 0, 258006
GlobalTracer [candidate] (258.699 ms) : 0, 258699
IAST [baseline] (24.177 ms) : 0, 24177
IAST [candidate] (24.278 ms) : 0, 24278
AppSec [baseline] (178.001 ms) : 0, 178001
AppSec [candidate] (178.069 ms) : 0, 178069
Debugger [baseline] (66.55 ms) : 0, 66550
Debugger [candidate] (66.67 ms) : 0, 66670
Remote Config [baseline] (624.589 µs) : 0, 625
Remote Config [candidate] (644.619 µs) : 0, 645
Telemetry [baseline] (8.225 ms) : 0, 8225
Telemetry [candidate] (8.44 ms) : 0, 8440
Flare Poller [baseline] (3.543 ms) : 0, 3543
Flare Poller [candidate] (3.643 ms) : 0, 3643
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (799.038 ms) : 0, 799038
BytebuddyAgent [candidate] (818.804 ms) : 0, 818804
AgentMeter [baseline] (11.454 ms) : 0, 11454
AgentMeter [candidate] (12.348 ms) : 0, 12348
GlobalTracer [baseline] (247.276 ms) : 0, 247276
GlobalTracer [candidate] (251.468 ms) : 0, 251468
IAST [baseline] (25.398 ms) : 0, 25398
IAST [candidate] (26.114 ms) : 0, 26114
AppSec [baseline] (26.666 ms) : 0, 26666
AppSec [candidate] (27.433 ms) : 0, 27433
Debugger [baseline] (70.707 ms) : 0, 70707
Debugger [candidate] (71.163 ms) : 0, 71163
Remote Config [baseline] (529.782 µs) : 0, 530
Remote Config [candidate] (525.203 µs) : 0, 525
Telemetry [baseline] (9.202 ms) : 0, 9202
Telemetry [candidate] (9.182 ms) : 0, 9182
Flare Poller [baseline] (3.405 ms) : 0, 3405
Flare Poller [candidate] (3.446 ms) : 0, 3446
section profiling
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.167 ms) : 0, 1167
BytebuddyAgent [baseline] (688.908 ms) : 0, 688908
BytebuddyAgent [candidate] (682.306 ms) : 0, 682306
AgentMeter [baseline] (9.046 ms) : 0, 9046
AgentMeter [candidate] (8.931 ms) : 0, 8931
GlobalTracer [baseline] (215.752 ms) : 0, 215752
GlobalTracer [candidate] (214.488 ms) : 0, 214488
AppSec [baseline] (32.407 ms) : 0, 32407
AppSec [candidate] (32.189 ms) : 0, 32189
Debugger [baseline] (65.534 ms) : 0, 65534
Debugger [candidate] (65.764 ms) : 0, 65764
Remote Config [baseline] (566.49 µs) : 0, 566
Remote Config [candidate] (557.462 µs) : 0, 557
Telemetry [baseline] (7.72 ms) : 0, 7720
Telemetry [candidate] (7.731 ms) : 0, 7731
Flare Poller [baseline] (4.218 ms) : 0, 4218
Flare Poller [candidate] (3.47 ms) : 0, 3470
ProfilingAgent [baseline] (93.781 ms) : 0, 93781
ProfilingAgent [candidate] (93.614 ms) : 0, 93614
Profiling [baseline] (94.34 ms) : 0, 94340
Profiling [candidate] (94.17 ms) : 0, 94170
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054021
Total [baseline] (8.843 s) : 0, 8842546
Agent [candidate] (1.063 s) : 0, 1062920
Total [candidate] (8.845 s) : 0, 8845231
section iast
Agent [baseline] (1.245 s) : 0, 1245015
Total [baseline] (9.596 s) : 0, 9596354
Agent [candidate] (1.23 s) : 0, 1229536
Total [candidate] (9.541 s) : 0, 9541175
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (627.987 ms) : 0, 627987
BytebuddyAgent [candidate] (633.572 ms) : 0, 633572
AgentMeter [baseline] (29.273 ms) : 0, 29273
AgentMeter [candidate] (29.501 ms) : 0, 29501
GlobalTracer [baseline] (256.017 ms) : 0, 256017
GlobalTracer [candidate] (257.658 ms) : 0, 257658
AppSec [baseline] (31.62 ms) : 0, 31620
AppSec [candidate] (31.91 ms) : 0, 31910
Debugger [baseline] (59.208 ms) : 0, 59208
Debugger [candidate] (59.98 ms) : 0, 59980
Remote Config [baseline] (581.292 µs) : 0, 581
Remote Config [candidate] (587.255 µs) : 0, 587
Telemetry [baseline] (8.01 ms) : 0, 8010
Telemetry [candidate] (8.027 ms) : 0, 8027
Flare Poller [baseline] (4.214 ms) : 0, 4214
Flare Poller [candidate] (4.32 ms) : 0, 4320
section iast
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (809.76 ms) : 0, 809760
BytebuddyAgent [candidate] (798.145 ms) : 0, 798145
AgentMeter [baseline] (11.679 ms) : 0, 11679
AgentMeter [candidate] (11.408 ms) : 0, 11408
GlobalTracer [baseline] (249.611 ms) : 0, 249611
GlobalTracer [candidate] (247.28 ms) : 0, 247280
IAST [baseline] (25.718 ms) : 0, 25718
IAST [candidate] (25.382 ms) : 0, 25382
AppSec [baseline] (27.741 ms) : 0, 27741
AppSec [candidate] (26.54 ms) : 0, 26540
Debugger [baseline] (67.706 ms) : 0, 67706
Debugger [candidate] (68.285 ms) : 0, 68285
Remote Config [baseline] (532.454 µs) : 0, 532
Remote Config [candidate] (529.208 µs) : 0, 529
Telemetry [baseline] (11.124 ms) : 0, 11124
Telemetry [candidate] (10.811 ms) : 0, 10811
Flare Poller [baseline] (3.536 ms) : 0, 3536
Flare Poller [candidate] (3.873 ms) : 0, 3873
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section baseline
no_agent (19.129 ms) : 18932, 19325
. : milestone, 19129,
appsec (18.562 ms) : 18377, 18747
. : milestone, 18562,
code_origins (17.694 ms) : 17517, 17870
. : milestone, 17694,
iast (17.623 ms) : 17445, 17801
. : milestone, 17623,
profiling (18.913 ms) : 18726, 19100
. : milestone, 18913,
tracing (17.804 ms) : 17630, 17978
. : milestone, 17804,
section candidate
no_agent (19.092 ms) : 18898, 19287
. : milestone, 19092,
appsec (18.444 ms) : 18257, 18631
. : milestone, 18444,
code_origins (17.993 ms) : 17810, 18175
. : milestone, 17993,
iast (18.058 ms) : 17879, 18237
. : milestone, 18058,
profiling (19.713 ms) : 19515, 19911
. : milestone, 19713,
tracing (18.062 ms) : 17882, 18242
. : milestone, 18062,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section baseline
no_agent (1.171 ms) : 1159, 1182
. : milestone, 1171,
iast (3.272 ms) : 3225, 3320
. : milestone, 3272,
iast_FULL (5.768 ms) : 5711, 5825
. : milestone, 5768,
iast_GLOBAL (3.438 ms) : 3380, 3496
. : milestone, 3438,
profiling (1.999 ms) : 1981, 2017
. : milestone, 1999,
tracing (1.772 ms) : 1757, 1787
. : milestone, 1772,
section candidate
no_agent (1.245 ms) : 1233, 1258
. : milestone, 1245,
iast (3.231 ms) : 3188, 3274
. : milestone, 3231,
iast_FULL (6.024 ms) : 5962, 6086
. : milestone, 6024,
iast_GLOBAL (3.617 ms) : 3563, 3671
. : milestone, 3617,
profiling (2.071 ms) : 2052, 2090
. : milestone, 2071,
tracing (1.774 ms) : 1760, 1789
. : milestone, 1774,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
. : milestone, 1471,
appsec (3.817 ms) : 3595, 4039
. : milestone, 3817,
iast (2.259 ms) : 2190, 2329
. : milestone, 2259,
iast_GLOBAL (2.295 ms) : 2225, 2364
. : milestone, 2295,
profiling (2.095 ms) : 2039, 2152
. : milestone, 2095,
tracing (2.067 ms) : 2013, 2120
. : milestone, 2067,
section candidate
no_agent (1.474 ms) : 1462, 1486
. : milestone, 1474,
appsec (3.824 ms) : 3596, 4053
. : milestone, 3824,
iast (2.251 ms) : 2182, 2321
. : milestone, 2251,
iast_GLOBAL (2.303 ms) : 2233, 2372
. : milestone, 2303,
profiling (2.114 ms) : 2057, 2171
. : milestone, 2114,
tracing (2.073 ms) : 2019, 2127
. : milestone, 2073,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a1239d32d8, baseline=1.61.0-SNAPSHOT~a1239d32d8
dateFormat X
axisFormat %s
section baseline
no_agent (15.501 s) : 15501000, 15501000
. : milestone, 15501000,
appsec (14.662 s) : 14662000, 14662000
. : milestone, 14662000,
iast (18.021 s) : 18021000, 18021000
. : milestone, 18021000,
iast_GLOBAL (17.704 s) : 17704000, 17704000
. : milestone, 17704000,
profiling (14.979 s) : 14979000, 14979000
. : milestone, 14979000,
tracing (14.907 s) : 14907000, 14907000
. : milestone, 14907000,
section candidate
no_agent (15.634 s) : 15634000, 15634000
. : milestone, 15634000,
appsec (14.828 s) : 14828000, 14828000
. : milestone, 14828000,
iast (18.276 s) : 18276000, 18276000
. : milestone, 18276000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
. : milestone, 17938000,
profiling (15.228 s) : 15228000, 15228000
. : milestone, 15228000,
tracing (15.109 s) : 15109000, 15109000
. : milestone, 15109000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:
Motivation
Keep smoke tests running against the latest stable versions of build tools.
Contributor Checklist