List iteration benchmark by dougqh · Pull Request #10888 · DataDog/dd-trace-java

dougqh · 2026-03-18T14:00:21Z

What Does This Do

Benchmark examining different ways to iterate over Lists: Collections.emptyList, Collections.singletonList, and ArrayList of different sizes

Covers multiple iteration options...

c-style for ( int i = 0; i < list.size(); ++i ) ...
iterator
enhanced for ( x : list ) (sugar for iterator)
List.forEach
List.stream
List.parallelStream

Each benchmark has a variation with and without the loop body fully inlined

Motivation

Illustrate overhead and make recommendations about the preferred way to iterate over lists in dd-java-agent.

Additional Notes

Recommends are...

prefer enhanced for -- except in the uncommon situation where escape analysis fails -- in that case, forEach or c-style are the best altenatives
avoid streams - always incur extra allocation - generally unnecessary for the task at hand

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-03-18T14:47:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1775589541	1775666866
git_commit_sha	`aa7c70f`	`b19d281`
release_version	1.61.0~aa7c70f2e7	1.61.0-SNAPSHOT~b19d2811ae

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775668566	1775668566
ci_job_id	1578333110	1578333110
ci_pipeline_id	106707970	106707970
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-evduivgi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-evduivgi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057685
Total [baseline] (11.033 s) : 0, 11033092
Agent [candidate] (1.052 s) : 0, 1052350
Total [candidate] (11.089 s) : 0, 11088871
section appsec
Agent [baseline] (1.248 s) : 0, 1248287
Total [baseline] (11.135 s) : 0, 11135246
Agent [candidate] (1.249 s) : 0, 1249401
Total [candidate] (11.145 s) : 0, 11144513
section iast
Agent [baseline] (1.224 s) : 0, 1224230
Total [baseline] (11.293 s) : 0, 11292841
Agent [candidate] (1.239 s) : 0, 1239499
Total [candidate] (11.413 s) : 0, 11412967
section profiling
Agent [baseline] (1.184 s) : 0, 1184098
Total [baseline] (11.027 s) : 0, 11026883
Agent [candidate] (1.186 s) : 0, 1185906
Total [candidate] (11.136 s) : 0, 11135802

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.248 s	190.602 ms (18.0%)
Agent	iast	1.224 s	166.545 ms (15.7%)
Agent	profiling	1.184 s	126.414 ms (12.0%)
Total	tracing	11.033 s	-
Total	appsec	11.135 s	102.154 ms (0.9%)
Total	iast	11.293 s	259.749 ms (2.4%)
Total	profiling	11.027 s	-6.209 ms (-0.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.249 s	197.051 ms (18.7%)
Agent	iast	1.239 s	187.149 ms (17.8%)
Agent	profiling	1.186 s	133.556 ms (12.7%)
Total	tracing	11.089 s	-
Total	appsec	11.145 s	55.642 ms (0.5%)
Total	iast	11.413 s	324.096 ms (2.9%)
Total	profiling	11.136 s	46.931 ms (0.4%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (633.62 ms) : 0, 633620
BytebuddyAgent [candidate] (631.491 ms) : 0, 631491
AgentMeter [baseline] (29.518 ms) : 0, 29518
AgentMeter [candidate] (29.281 ms) : 0, 29281
GlobalTracer [baseline] (248.97 ms) : 0, 248970
GlobalTracer [candidate] (248.716 ms) : 0, 248716
AppSec [baseline] (31.941 ms) : 0, 31941
AppSec [candidate] (31.916 ms) : 0, 31916
Debugger [baseline] (59.952 ms) : 0, 59952
Debugger [candidate] (59.787 ms) : 0, 59787
Remote Config [baseline] (599.653 µs) : 0, 600
Remote Config [candidate] (592.757 µs) : 0, 593
Telemetry [baseline] (8.097 ms) : 0, 8097
Telemetry [candidate] (8.053 ms) : 0, 8053
Flare Poller [baseline] (7.451 ms) : 0, 7451
Flare Poller [candidate] (5.124 ms) : 0, 5124
section appsec
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (662.076 ms) : 0, 662076
BytebuddyAgent [candidate] (662.45 ms) : 0, 662450
AgentMeter [baseline] (11.999 ms) : 0, 11999
AgentMeter [candidate] (11.989 ms) : 0, 11989
GlobalTracer [baseline] (249.279 ms) : 0, 249279
GlobalTracer [candidate] (249.113 ms) : 0, 249113
IAST [baseline] (24.632 ms) : 0, 24632
IAST [candidate] (24.608 ms) : 0, 24608
AppSec [baseline] (184.515 ms) : 0, 184515
AppSec [candidate] (184.656 ms) : 0, 184656
Debugger [baseline] (65.485 ms) : 0, 65485
Debugger [candidate] (66.188 ms) : 0, 66188
Remote Config [baseline] (596.142 µs) : 0, 596
Remote Config [candidate] (595.188 µs) : 0, 595
Telemetry [baseline] (8.601 ms) : 0, 8601
Telemetry [candidate] (8.552 ms) : 0, 8552
Flare Poller [baseline] (3.525 ms) : 0, 3525
Flare Poller [candidate] (3.551 ms) : 0, 3551
section iast
crashtracking [baseline] (1.229 ms) : 0, 1229
crashtracking [candidate] (1.246 ms) : 0, 1246
BytebuddyAgent [baseline] (801.114 ms) : 0, 801114
BytebuddyAgent [candidate] (813.744 ms) : 0, 813744
AgentMeter [baseline] (11.402 ms) : 0, 11402
AgentMeter [candidate] (11.638 ms) : 0, 11638
GlobalTracer [baseline] (239.107 ms) : 0, 239107
GlobalTracer [candidate] (240.685 ms) : 0, 240685
IAST [baseline] (25.721 ms) : 0, 25721
IAST [candidate] (25.872 ms) : 0, 25872
AppSec [baseline] (31.809 ms) : 0, 31809
AppSec [candidate] (29.452 ms) : 0, 29452
Debugger [baseline] (59.989 ms) : 0, 59989
Debugger [candidate] (63.374 ms) : 0, 63374
Remote Config [baseline] (1.73 ms) : 0, 1730
Remote Config [candidate] (1.767 ms) : 0, 1767
Telemetry [baseline] (12.493 ms) : 0, 12493
Telemetry [candidate] (11.845 ms) : 0, 11845
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.459 ms) : 0, 3459
section profiling
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (691.015 ms) : 0, 691015
BytebuddyAgent [candidate] (691.526 ms) : 0, 691526
AgentMeter [baseline] (9.14 ms) : 0, 9140
AgentMeter [candidate] (9.228 ms) : 0, 9228
GlobalTracer [baseline] (207.399 ms) : 0, 207399
GlobalTracer [candidate] (207.607 ms) : 0, 207607
AppSec [baseline] (32.51 ms) : 0, 32510
AppSec [candidate] (32.752 ms) : 0, 32752
Debugger [baseline] (65.543 ms) : 0, 65543
Debugger [candidate] (65.888 ms) : 0, 65888
Remote Config [baseline] (566.891 µs) : 0, 567
Remote Config [candidate] (585.275 µs) : 0, 585
Telemetry [baseline] (7.905 ms) : 0, 7905
Telemetry [candidate] (7.783 ms) : 0, 7783
Flare Poller [baseline] (3.572 ms) : 0, 3572
Flare Poller [candidate] (3.598 ms) : 0, 3598
ProfilingAgent [baseline] (93.987 ms) : 0, 93987
ProfilingAgent [candidate] (94.459 ms) : 0, 94459
Profiling [baseline] (94.557 ms) : 0, 94557
Profiling [candidate] (95.04 ms) : 0, 95040

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054800
Total [baseline] (8.847 s) : 0, 8847310
Agent [candidate] (1.054 s) : 0, 1054353
Total [candidate] (8.854 s) : 0, 8854419
section iast
Agent [baseline] (1.225 s) : 0, 1225473
Total [baseline] (9.593 s) : 0, 9593228
Agent [candidate] (1.222 s) : 0, 1221954
Total [candidate] (9.586 s) : 0, 9586444

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	iast	1.225 s	170.673 ms (16.2%)
Total	tracing	8.847 s	-
Total	iast	9.593 s	745.918 ms (8.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.222 s	167.602 ms (15.9%)
Total	tracing	8.854 s	-
Total	iast	9.586 s	732.026 ms (8.3%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (633.095 ms) : 0, 633095
BytebuddyAgent [candidate] (632.475 ms) : 0, 632475
AgentMeter [baseline] (29.399 ms) : 0, 29399
AgentMeter [candidate] (29.408 ms) : 0, 29408
GlobalTracer [baseline] (248.08 ms) : 0, 248080
GlobalTracer [candidate] (248.939 ms) : 0, 248939
AppSec [baseline] (31.896 ms) : 0, 31896
AppSec [candidate] (31.985 ms) : 0, 31985
Debugger [baseline] (58.843 ms) : 0, 58843
Debugger [candidate] (59.058 ms) : 0, 59058
Remote Config [baseline] (605.684 µs) : 0, 606
Remote Config [candidate] (593.087 µs) : 0, 593
Telemetry [baseline] (8.038 ms) : 0, 8038
Telemetry [candidate] (8.081 ms) : 0, 8081
Flare Poller [baseline] (7.446 ms) : 0, 7446
Flare Poller [candidate] (6.543 ms) : 0, 6543
section iast
crashtracking [baseline] (1.244 ms) : 0, 1244
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (802.829 ms) : 0, 802829
BytebuddyAgent [candidate] (800.335 ms) : 0, 800335
AgentMeter [baseline] (11.438 ms) : 0, 11438
AgentMeter [candidate] (11.34 ms) : 0, 11340
GlobalTracer [baseline] (239.385 ms) : 0, 239385
GlobalTracer [candidate] (239.241 ms) : 0, 239241
IAST [baseline] (26.586 ms) : 0, 26586
IAST [candidate] (25.731 ms) : 0, 25731
AppSec [baseline] (32.608 ms) : 0, 32608
AppSec [candidate] (30.719 ms) : 0, 30719
Debugger [baseline] (57.529 ms) : 0, 57529
Debugger [candidate] (58.576 ms) : 0, 58576
Remote Config [baseline] (1.141 ms) : 0, 1141
Remote Config [candidate] (518.965 µs) : 0, 519
Telemetry [baseline] (12.957 ms) : 0, 12957
Telemetry [candidate] (14.408 ms) : 0, 14408
Flare Poller [baseline] (3.482 ms) : 0, 3482
Flare Poller [candidate] (3.633 ms) : 0, 3633

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1775589541	1775666866
git_commit_sha	`aa7c70f`	`b19d281`
release_version	1.61.0~aa7c70f2e7	1.61.0-SNAPSHOT~b19d2811ae

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1775669142	1775669142
ci_job_id	1578333113	1578333113
ci_pipeline_id	106707970	106707970
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-fztbxxk0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-fztbxxk0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 4 performance regressions! Performance is the same for 13 metrics, 18 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+35.447µs; +172.357µs] or [+2.045%; +9.943%]	unstable [-73.414µs; +899.800µs] or [-1.430%; +17.528%]	unstable [-391.878op/s; +65.065op/s] or [-18.674%; +3.101%]	1.837ms	5.547ms	1935.094op/s	1.733ms	5.133ms	2098.500op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+208.931µs; +345.938µs] or [+7.699%; +12.748%]	worse [+477.997µs; +887.918µs] or [+6.230%; +11.572%]	unstable [-251.902op/s; +18.089op/s] or [-18.901%; +1.357%]	2.991ms	8.356ms	1215.844op/s	2.714ms	7.673ms	1332.750op/s
scenario:load:petclinic:code_origins:high_load	better [-900.318µs; -500.300µs] or [-5.028%; -2.794%]	unsure [-1057.056µs; -202.258µs] or [-3.609%; -0.691%]	unstable [-19.592op/s; +22.330op/s] or [-7.444%; +8.484%]	17.208ms	28.661ms	264.562op/s	17.908ms	29.290ms	263.194op/s
scenario:load:petclinic:iast:high_load	worse [+536.670µs; +1073.805µs] or [+3.072%; +6.147%]	unsure [+0.518ms; +1.551ms] or [+1.811%; +5.429%]	unstable [-40.679op/s; +0.984op/s] or [-15.004%; +0.363%]	18.274ms	29.610ms	251.281op/s	17.469ms	28.575ms	271.129op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.247 ms) : 1235, 1259
.   : milestone, 1247,
iast (3.234 ms) : 3195, 3272
.   : milestone, 3234,
iast_FULL (5.971 ms) : 5912, 6031
.   : milestone, 5971,
iast_GLOBAL (3.443 ms) : 3393, 3492
.   : milestone, 3443,
profiling (2.156 ms) : 2134, 2178
.   : milestone, 2156,
tracing (1.869 ms) : 1854, 1885
.   : milestone, 1869,
section candidate
no_agent (1.239 ms) : 1227, 1251
.   : milestone, 1239,
iast (3.318 ms) : 3269, 3368
.   : milestone, 3318,
iast_FULL (6.105 ms) : 6042, 6169
.   : milestone, 6105,
iast_GLOBAL (3.776 ms) : 3708, 3844
.   : milestone, 3776,
profiling (2.343 ms) : 2320, 2366
.   : milestone, 2343,
tracing (1.867 ms) : 1851, 1883
.   : milestone, 1867,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.247 ms [1.235 ms, 1.259 ms]	-
iast	3.234 ms [3.195 ms, 3.272 ms]	1.986 ms (159.2%)
iast_FULL	5.971 ms [5.912 ms, 6.031 ms]	4.724 ms (378.8%)
iast_GLOBAL	3.443 ms [3.393 ms, 3.492 ms]	2.195 ms (176.0%)
profiling	2.156 ms [2.134 ms, 2.178 ms]	908.714 µs (72.9%)
tracing	1.869 ms [1.854 ms, 1.885 ms]	621.99 µs (49.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.239 ms [1.227 ms, 1.251 ms]	-
iast	3.318 ms [3.269 ms, 3.368 ms]	2.079 ms (167.8%)
iast_FULL	6.105 ms [6.042 ms, 6.169 ms]	4.866 ms (392.7%)
iast_GLOBAL	3.776 ms [3.708 ms, 3.844 ms]	2.537 ms (204.7%)
profiling	2.343 ms [2.32 ms, 2.366 ms]	1.104 ms (89.1%)
tracing	1.867 ms [1.851 ms, 1.883 ms]	627.96 µs (50.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.19 ms) : 18995, 19384
.   : milestone, 19190,
appsec (18.394 ms) : 18210, 18578
.   : milestone, 18394,
code_origins (18.302 ms) : 18119, 18484
.   : milestone, 18302,
iast (17.761 ms) : 17587, 17935
.   : milestone, 17761,
profiling (19.244 ms) : 19045, 19443
.   : milestone, 19244,
tracing (17.903 ms) : 17726, 18081
.   : milestone, 17903,
section candidate
no_agent (17.03 ms) : 16865, 17196
.   : milestone, 17030,
appsec (18.631 ms) : 18440, 18821
.   : milestone, 18631,
code_origins (17.634 ms) : 17453, 17814
.   : milestone, 17634,
iast (18.575 ms) : 18390, 18759
.   : milestone, 18575,
profiling (19.149 ms) : 18956, 19342
.   : milestone, 19149,
tracing (18.154 ms) : 17972, 18335
.   : milestone, 18154,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.19 ms [18.995 ms, 19.384 ms]	-
appsec	18.394 ms [18.21 ms, 18.578 ms]	-795.479 µs (-4.1%)
code_origins	18.302 ms [18.119 ms, 18.484 ms]	-888.005 µs (-4.6%)
iast	17.761 ms [17.587 ms, 17.935 ms]	-1.429 ms (-7.4%)
profiling	19.244 ms [19.045 ms, 19.443 ms]	54.158 µs (0.3%)
tracing	17.903 ms [17.726 ms, 18.081 ms]	-1.286 ms (-6.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.03 ms [16.865 ms, 17.196 ms]	-
appsec	18.631 ms [18.44 ms, 18.821 ms]	1.6 ms (9.4%)
code_origins	17.634 ms [17.453 ms, 17.814 ms]	603.084 µs (3.5%)
iast	18.575 ms [18.39 ms, 18.759 ms]	1.544 ms (9.1%)
profiling	19.149 ms [18.956 ms, 19.342 ms]	2.119 ms (12.4%)
tracing	18.154 ms [17.972 ms, 18.335 ms]	1.123 ms (6.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1775589541	1775666866
git_commit_sha	`aa7c70f`	`b19d281`
release_version	1.61.0~aa7c70f2e7	1.61.0-SNAPSHOT~b19d2811ae

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1775668874	1775668874
ci_job_id	1578333116	1578333116
ci_pipeline_id	106707970	106707970
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-epztodun 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-epztodun 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.489ms; -1.139ms] or [-38.713%; -29.628%]	2.531ms	3.845ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.489 ms) : 1478, 1501
.   : milestone, 1489,
appsec (3.845 ms) : 3623, 4068
.   : milestone, 3845,
iast (2.277 ms) : 2208, 2346
.   : milestone, 2277,
iast_GLOBAL (2.326 ms) : 2257, 2395
.   : milestone, 2326,
profiling (2.094 ms) : 2039, 2149
.   : milestone, 2094,
tracing (2.08 ms) : 2026, 2133
.   : milestone, 2080,
section candidate
no_agent (1.492 ms) : 1481, 1504
.   : milestone, 1492,
appsec (2.531 ms) : 2477, 2586
.   : milestone, 2531,
iast (2.28 ms) : 2210, 2349
.   : milestone, 2280,
iast_GLOBAL (2.323 ms) : 2253, 2393
.   : milestone, 2323,
profiling (2.099 ms) : 2045, 2154
.   : milestone, 2099,
tracing (2.081 ms) : 2028, 2135
.   : milestone, 2081,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.489 ms [1.478 ms, 1.501 ms]	-
appsec	3.845 ms [3.623 ms, 4.068 ms]	2.356 ms (158.2%)
iast	2.277 ms [2.208 ms, 2.346 ms]	787.58 µs (52.9%)
iast_GLOBAL	2.326 ms [2.257 ms, 2.395 ms]	836.59 µs (56.2%)
profiling	2.094 ms [2.039 ms, 2.149 ms]	604.509 µs (40.6%)
tracing	2.08 ms [2.026 ms, 2.133 ms]	590.396 µs (39.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.492 ms [1.481 ms, 1.504 ms]	-
appsec	2.531 ms [2.477 ms, 2.586 ms]	1.039 ms (69.6%)
iast	2.28 ms [2.21 ms, 2.349 ms]	787.317 µs (52.8%)
iast_GLOBAL	2.323 ms [2.253 ms, 2.393 ms]	830.846 µs (55.7%)
profiling	2.099 ms [2.045 ms, 2.154 ms]	607.167 µs (40.7%)
tracing	2.081 ms [2.028 ms, 2.135 ms]	588.94 µs (39.5%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~b19d2811ae, baseline=1.61.0~aa7c70f2e7
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.822 s) : 14822000, 14822000
.   : milestone, 14822000,
appsec (14.978 s) : 14978000, 14978000
.   : milestone, 14978000,
iast (18.332 s) : 18332000, 18332000
.   : milestone, 18332000,
iast_GLOBAL (18.193 s) : 18193000, 18193000
.   : milestone, 18193000,
profiling (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
tracing (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
section candidate
no_agent (14.999 s) : 14999000, 14999000
.   : milestone, 14999000,
appsec (14.696 s) : 14696000, 14696000
.   : milestone, 14696000,
iast (18.107 s) : 18107000, 18107000
.   : milestone, 18107000,
iast_GLOBAL (18.315 s) : 18315000, 18315000
.   : milestone, 18315000,
profiling (15.508 s) : 15508000, 15508000
.   : milestone, 15508000,
tracing (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.822 s [14.822 s, 14.822 s]	-
appsec	14.978 s [14.978 s, 14.978 s]	156.0 ms (1.1%)
iast	18.332 s [18.332 s, 18.332 s]	3.51 s (23.7%)
iast_GLOBAL	18.193 s [18.193 s, 18.193 s]	3.371 s (22.7%)
profiling	14.977 s [14.977 s, 14.977 s]	155.0 ms (1.0%)
tracing	15.165 s [15.165 s, 15.165 s]	343.0 ms (2.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.999 s [14.999 s, 14.999 s]	-
appsec	14.696 s [14.696 s, 14.696 s]	-303.0 ms (-2.0%)
iast	18.107 s [18.107 s, 18.107 s]	3.108 s (20.7%)
iast_GLOBAL	18.315 s [18.315 s, 18.315 s]	3.316 s (22.1%)
profiling	15.508 s [15.508 s, 15.508 s]	509.0 ms (3.4%)
tracing	14.906 s [14.906 s, 14.906 s]	-93.0 ms (-0.6%)

…tion earlier

Adding missing end ul to doc Moving iterator benchmarks next to enhancedFor

…dd-trace-java into dougqh/list-iteration-benchmark

List iteration benchmark

d2a2295

dougqh requested a review from a team as a code owner March 18, 2026 14:00

dougqh requested a review from ygree March 18, 2026 14:00

dougqh added comp: core Tracer core type: documentation tag: performance Performance related changes labels Mar 18, 2026

Merge branch 'master' into dougqh/list-iteration-benchmark

372dff0

dougqh added 5 commits March 18, 2026 13:14

Fixing silly oversight - commented out benchmarks to run one in isola…

54883cd

…tion earlier

A bit of clean-up

d002783

Adding missing end ul to doc Moving iterator benchmarks next to enhancedFor

Merge branch 'master' into dougqh/list-iteration-benchmark

0636a14

spotless

27a33f0

Merge branch 'dougqh/list-iteration-benchmark' of github.com:DataDog/…

b19d281

…dd-trace-java into dougqh/list-iteration-benchmark

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

List iteration benchmark#10888

List iteration benchmark#10888
dougqh wants to merge 7 commits intomasterfrom
dougqh/list-iteration-benchmark

dougqh commented Mar 18, 2026

Uh oh!

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dougqh commented Mar 18, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pr-commenter bot commented Mar 18, 2026 •

edited

Loading