Skip to content

Fix EMR Spark support by using Seq instead of ArrayBuffer for externa…#10987

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
adrien.boitreaud/use-seq-to-fix-emr-support
Mar 30, 2026
Merged

Fix EMR Spark support by using Seq instead of ArrayBuffer for externa…#10987
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
adrien.boitreaud/use-seq-to-fix-emr-support

Conversation

@aboitreaud
Copy link
Copy Markdown
Contributor

@aboitreaud aboitreaud commented Mar 27, 2026 •
edited
Loading

What Does This Do

Changes the type used to receive the result of externalAccums from ArrayBuffer to Seq in both Spark 2.12 and 2.13 listeners.

Motivation

On Amazon EMR, the externalAccums method returns a JListWrapper — a Java-to-Scala collection wrapper that implements Seq but is not an ArrayBuffer. Casting to ArrayBuffer caused a ClassCastException that crashed the Spark listener, silently breaking all task-level accumulator collection:

ERROR AsyncEventQueue: Listener DatadogSpark212Listener threw an exception
java.lang.ClassCastException: class scala.collection.convert.Wrappers$JListWrapper cannot be cast to class scala.collection.mutable.ArrayBuffer
    at datadog.trace.instrumentation.spark.DatadogSpark212Listener.getExternalAccumulators(DatadogSpark212Listener.java:94)
    at datadog.trace.instrumentation.spark.AbstractDatadogSparkListener.onTaskEnd(AbstractDatadogSparkListener.java:696)
    at org.apache.spark.scheduler.SparkListenerBus.doPostEvent(SparkListenerBus.scala:45)
    ...

Seq is the correct supertype: ArrayBuffer is a Seq, and so is JListWrapper. Using Seq makes the code work regardless of which concrete implementation the Spark distribution returns. The downstream call to JavaConverters.seqAsJavaList / CollectionConverters.asJava accepts Seq, so no other change is needed.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 27, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/use-seq-to-fix-emr-support
git_commit_date 1774619422 1774630389
git_commit_sha 1abe140 0cb0687
release_version 1.61.0-SNAPSHOT~1abe140bde 1.61.0-SNAPSHOT~0cb068786f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774632293 1774632293
ci_job_id 1546391124 1546391124
ci_pipeline_id 104808903 104808903
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b5yw6u6u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b5yw6u6u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064739
Total [baseline] (11.063 s) : 0, 11062658
Agent [candidate] (1.056 s) : 0, 1056373
Total [candidate] (11.037 s) : 0, 11037017
section appsec
Agent [baseline] (1.249 s) : 0, 1248914
Total [baseline] (11.183 s) : 0, 11182584
Agent [candidate] (1.248 s) : 0, 1247867
Total [candidate] (11.251 s) : 0, 11250594
section iast
Agent [baseline] (1.236 s) : 0, 1236329
Total [baseline] (11.307 s) : 0, 11307439
Agent [candidate] (1.231 s) : 0, 1231445
Total [candidate] (11.347 s) : 0, 11346864
section profiling
Agent [baseline] (1.182 s) : 0, 1181789
Total [baseline] (11.132 s) : 0, 11131669
Agent [candidate] (1.182 s) : 0, 1182233
Total [candidate] (11.059 s) : 0, 11058791
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.249 s 184.174 ms (17.3%)
Agent iast 1.236 s 171.59 ms (16.1%)
Agent profiling 1.182 s 117.05 ms (11.0%)
Total tracing 11.063 s -
Total appsec 11.183 s 119.926 ms (1.1%)
Total iast 11.307 s 244.781 ms (2.2%)
Total profiling 11.132 s 69.011 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.248 s 191.494 ms (18.1%)
Agent iast 1.231 s 175.072 ms (16.6%)
Agent profiling 1.182 s 125.86 ms (11.9%)
Total tracing 11.037 s -
Total appsec 11.251 s 213.578 ms (1.9%)
Total iast 11.347 s 309.848 ms (2.8%)
Total profiling 11.059 s 21.774 ms (0.2%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (632.562 ms) : 0, 632562
BytebuddyAgent [candidate] (628.836 ms) : 0, 628836
AgentMeter [baseline] (29.627 ms) : 0, 29627
AgentMeter [candidate] (29.346 ms) : 0, 29346
GlobalTracer [baseline] (258.749 ms) : 0, 258749
GlobalTracer [candidate] (256.817 ms) : 0, 256817
AppSec [baseline] (31.955 ms) : 0, 31955
AppSec [candidate] (31.693 ms) : 0, 31693
Debugger [baseline] (60.661 ms) : 0, 60661
Debugger [candidate] (60.224 ms) : 0, 60224
Remote Config [baseline] (589.427 µs) : 0, 589
Remote Config [candidate] (616.855 µs) : 0, 617
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.004 ms) : 0, 8004
Flare Poller [baseline] (5.05 ms) : 0, 5050
Flare Poller [candidate] (3.526 ms) : 0, 3526
section appsec
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (659.622 ms) : 0, 659622
BytebuddyAgent [candidate] (659.756 ms) : 0, 659756
AgentMeter [baseline] (12.136 ms) : 0, 12136
AgentMeter [candidate] (12.112 ms) : 0, 12112
GlobalTracer [baseline] (258.61 ms) : 0, 258610
GlobalTracer [candidate] (257.721 ms) : 0, 257721
IAST [baseline] (24.145 ms) : 0, 24145
IAST [candidate] (24.139 ms) : 0, 24139
AppSec [baseline] (177.997 ms) : 0, 177997
AppSec [candidate] (177.844 ms) : 0, 177844
Debugger [baseline] (66.41 ms) : 0, 66410
Debugger [candidate] (66.276 ms) : 0, 66276
Remote Config [baseline] (625.844 µs) : 0, 626
Remote Config [candidate] (632.979 µs) : 0, 633
Telemetry [baseline] (8.318 ms) : 0, 8318
Telemetry [candidate] (8.262 ms) : 0, 8262
Flare Poller [baseline] (3.553 ms) : 0, 3553
Flare Poller [candidate] (3.545 ms) : 0, 3545
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (802.701 ms) : 0, 802701
BytebuddyAgent [candidate] (798.898 ms) : 0, 798898
AgentMeter [baseline] (11.492 ms) : 0, 11492
AgentMeter [candidate] (11.443 ms) : 0, 11443
GlobalTracer [baseline] (248.53 ms) : 0, 248530
GlobalTracer [candidate] (248.063 ms) : 0, 248063
IAST [baseline] (25.527 ms) : 0, 25527
IAST [candidate] (25.404 ms) : 0, 25404
AppSec [baseline] (26.711 ms) : 0, 26711
AppSec [candidate] (26.687 ms) : 0, 26687
Debugger [baseline] (69.979 ms) : 0, 69979
Debugger [candidate] (70.622 ms) : 0, 70622
Remote Config [baseline] (531.548 µs) : 0, 532
Remote Config [candidate] (532.223 µs) : 0, 532
Telemetry [baseline] (9.716 ms) : 0, 9716
Telemetry [candidate] (9.113 ms) : 0, 9113
Flare Poller [baseline] (3.573 ms) : 0, 3573
Flare Poller [candidate] (3.316 ms) : 0, 3316
section profiling
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (682.397 ms) : 0, 682397
BytebuddyAgent [candidate] (682.625 ms) : 0, 682625
AgentMeter [baseline] (8.987 ms) : 0, 8987
AgentMeter [candidate] (9.032 ms) : 0, 9032
GlobalTracer [baseline] (214.457 ms) : 0, 214457
GlobalTracer [candidate] (214.976 ms) : 0, 214976
AppSec [baseline] (32.193 ms) : 0, 32193
AppSec [candidate] (32.188 ms) : 0, 32188
Debugger [baseline] (65.829 ms) : 0, 65829
Debugger [candidate] (65.882 ms) : 0, 65882
Remote Config [baseline] (569.367 µs) : 0, 569
Remote Config [candidate] (574.471 µs) : 0, 574
Telemetry [baseline] (7.682 ms) : 0, 7682
Telemetry [candidate] (7.779 ms) : 0, 7779
Flare Poller [baseline] (3.503 ms) : 0, 3503
Flare Poller [candidate] (3.524 ms) : 0, 3524
ProfilingAgent [baseline] (94.215 ms) : 0, 94215
ProfilingAgent [candidate] (93.644 ms) : 0, 93644
Profiling [baseline] (94.779 ms) : 0, 94779
Profiling [candidate] (94.198 ms) : 0, 94198
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057695
Total [baseline] (8.896 s) : 0, 8896090
Agent [candidate] (1.056 s) : 0, 1056457
Total [candidate] (8.842 s) : 0, 8841728
section iast
Agent [baseline] (1.237 s) : 0, 1236904
Total [baseline] (9.579 s) : 0, 9579055
Agent [candidate] (1.232 s) : 0, 1231949
Total [candidate] (9.587 s) : 0, 9587095
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.237 s 179.209 ms (16.9%)
Total tracing 8.896 s -
Total iast 9.579 s 682.966 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.232 s 175.493 ms (16.6%)
Total tracing 8.842 s -
Total iast 9.587 s 745.367 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (629.379 ms) : 0, 629379
BytebuddyAgent [candidate] (628.836 ms) : 0, 628836
AgentMeter [baseline] (29.352 ms) : 0, 29352
AgentMeter [candidate] (29.238 ms) : 0, 29238
GlobalTracer [baseline] (256.715 ms) : 0, 256715
GlobalTracer [candidate] (257.046 ms) : 0, 257046
AppSec [baseline] (31.764 ms) : 0, 31764
AppSec [candidate] (31.709 ms) : 0, 31709
Debugger [baseline] (59.565 ms) : 0, 59565
Debugger [candidate] (59.427 ms) : 0, 59427
Remote Config [baseline] (589.206 µs) : 0, 589
Remote Config [candidate] (582.687 µs) : 0, 583
Telemetry [baseline] (8.074 ms) : 0, 8074
Telemetry [candidate] (8.067 ms) : 0, 8067
Flare Poller [baseline] (4.994 ms) : 0, 4994
Flare Poller [candidate] (4.246 ms) : 0, 4246
section iast
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (803.712 ms) : 0, 803712
BytebuddyAgent [candidate] (799.879 ms) : 0, 799879
AgentMeter [baseline] (11.676 ms) : 0, 11676
AgentMeter [candidate] (11.438 ms) : 0, 11438
GlobalTracer [baseline] (248.942 ms) : 0, 248942
GlobalTracer [candidate] (248.249 ms) : 0, 248249
IAST [baseline] (25.591 ms) : 0, 25591
IAST [candidate] (25.408 ms) : 0, 25408
AppSec [baseline] (26.758 ms) : 0, 26758
AppSec [candidate] (26.615 ms) : 0, 26615
Debugger [baseline] (66.298 ms) : 0, 66298
Debugger [candidate] (66.626 ms) : 0, 66626
Remote Config [baseline] (521.605 µs) : 0, 522
Remote Config [candidate] (518.503 µs) : 0, 519
Telemetry [baseline] (11.748 ms) : 0, 11748
Telemetry [candidate] (11.673 ms) : 0, 11673
Flare Poller [baseline] (4.121 ms) : 0, 4121
Flare Poller [candidate] (4.105 ms) : 0, 4105
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/use-seq-to-fix-emr-support
git_commit_date 1774619422 1774630389
git_commit_sha 1abe140 0cb0687
release_version 1.61.0-SNAPSHOT~1abe140bde 1.61.0-SNAPSHOT~0cb068786f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1774632664 1774632664
ci_job_id 1546391125 1546391125
ci_pipeline_id 104808903 104808903
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-0f305xi1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-0f305xi1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-226.571µs; -126.363µs] or [-8.844%; -4.932%]		 unsure
[-441.459µs; -96.143µs] or [-5.967%; -1.299%]		 unstable
[-80.547op/s; +241.609op/s] or [-5.747%; +17.239%]		 2.385ms 7.130ms 1482.094op/s 2.562ms 7.399ms 1401.562op/s
scenario:load:petclinic:profiling:high_load worse
[+0.925ms; +1.672ms] or [+5.128%; +9.266%]		 worse
[+1.046ms; +2.560ms] or [+3.594%; +8.793%]		 unstable
[-41.051op/s; +9.551op/s] or [-16.122%; +3.751%]		 19.346ms 30.913ms 238.875op/s 18.047ms 29.110ms 254.625op/s
scenario:load:petclinic:tracing:high_load worse
[+0.814ms; +1.580ms] or [+4.723%; +9.165%]		 same
[-65.664µs; +1422.070µs] or [-0.231%; +5.001%]		 unstable
[-41.342op/s; +11.842op/s] or [-15.584%; +4.464%]		 18.436ms 29.111ms 250.531op/s 17.238ms 28.433ms 265.281op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.174 ms) : 1162, 1185
.   : milestone, 1174,
iast (3.266 ms) : 3223, 3309
.   : milestone, 3266,
iast_FULL (5.939 ms) : 5879, 5999
.   : milestone, 5939,
iast_GLOBAL (3.632 ms) : 3573, 3691
.   : milestone, 3632,
profiling (2.229 ms) : 2208, 2251
.   : milestone, 2229,
tracing (1.78 ms) : 1764, 1795
.   : milestone, 1780,
section candidate
no_agent (1.176 ms) : 1164, 1187
.   : milestone, 1176,
iast (3.084 ms) : 3044, 3124
.   : milestone, 3084,
iast_FULL (5.909 ms) : 5849, 5969
.   : milestone, 5909,
iast_GLOBAL (3.541 ms) : 3487, 3596
.   : milestone, 3541,
profiling (2.194 ms) : 2174, 2214
.   : milestone, 2194,
tracing (1.786 ms) : 1771, 1801
.   : milestone, 1786,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.162 ms, 1.185 ms] -
iast 3.266 ms [3.223 ms, 3.309 ms] 2.092 ms (178.3%)
iast_FULL 5.939 ms [5.879 ms, 5.999 ms] 4.765 ms (406.0%)
iast_GLOBAL 3.632 ms [3.573 ms, 3.691 ms] 2.458 ms (209.5%)
profiling 2.229 ms [2.208 ms, 2.251 ms] 1.056 ms (90.0%)
tracing 1.78 ms [1.764 ms, 1.795 ms] 605.981 µs (51.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.164 ms, 1.187 ms] -
iast 3.084 ms [3.044 ms, 3.124 ms] 1.908 ms (162.3%)
iast_FULL 5.909 ms [5.849 ms, 5.969 ms] 4.733 ms (402.6%)
iast_GLOBAL 3.541 ms [3.487 ms, 3.596 ms] 2.365 ms (201.2%)
profiling 2.194 ms [2.174 ms, 2.214 ms] 1.018 ms (86.6%)
tracing 1.786 ms [1.771 ms, 1.801 ms] 610.275 µs (51.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.416 ms) : 17236, 17596
.   : milestone, 17416,
appsec (18.456 ms) : 18270, 18642
.   : milestone, 18456,
code_origins (17.732 ms) : 17554, 17909
.   : milestone, 17732,
iast (17.833 ms) : 17654, 18013
.   : milestone, 17833,
profiling (18.325 ms) : 18145, 18505
.   : milestone, 18325,
tracing (17.586 ms) : 17411, 17761
.   : milestone, 17586,
section candidate
no_agent (18.568 ms) : 18375, 18762
.   : milestone, 18568,
appsec (18.49 ms) : 18300, 18679
.   : milestone, 18490,
code_origins (17.859 ms) : 17680, 18039
.   : milestone, 17859,
iast (17.439 ms) : 17265, 17614
.   : milestone, 17439,
profiling (19.541 ms) : 19343, 19739
.   : milestone, 19541,
tracing (18.632 ms) : 18448, 18816
.   : milestone, 18632,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.416 ms [17.236 ms, 17.596 ms] -
appsec 18.456 ms [18.27 ms, 18.642 ms] 1.04 ms (6.0%)
code_origins 17.732 ms [17.554 ms, 17.909 ms] 315.237 µs (1.8%)
iast 17.833 ms [17.654 ms, 18.013 ms] 416.986 µs (2.4%)
profiling 18.325 ms [18.145 ms, 18.505 ms] 908.809 µs (5.2%)
tracing 17.586 ms [17.411 ms, 17.761 ms] 170.066 µs (1.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.568 ms [18.375 ms, 18.762 ms] -
appsec 18.49 ms [18.3 ms, 18.679 ms] -78.668 µs (-0.4%)
code_origins 17.859 ms [17.68 ms, 18.039 ms] -708.869 µs (-3.8%)
iast 17.439 ms [17.265 ms, 17.614 ms] -1.129 ms (-6.1%)
profiling 19.541 ms [19.343 ms, 19.739 ms] 972.888 µs (5.2%)
tracing 18.632 ms [18.448 ms, 18.816 ms] 63.538 µs (0.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/use-seq-to-fix-emr-support
git_commit_date 1774619422 1774630389
git_commit_sha 1abe140 0cb0687
release_version 1.61.0-SNAPSHOT~1abe140bde 1.61.0-SNAPSHOT~0cb068786f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1774632503 1774632503
ci_job_id 1546391127 1546391127
ci_pipeline_id 104808903 104808903
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-xl3suiqk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-xl3suiqk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
appsec (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,
iast (18.135 s) : 18135000, 18135000
.   : milestone, 18135000,
iast_GLOBAL (17.896 s) : 17896000, 17896000
.   : milestone, 17896000,
profiling (14.924 s) : 14924000, 14924000
.   : milestone, 14924000,
tracing (14.799 s) : 14799000, 14799000
.   : milestone, 14799000,
section candidate
no_agent (15.553 s) : 15553000, 15553000
.   : milestone, 15553000,
appsec (14.689 s) : 14689000, 14689000
.   : milestone, 14689000,
iast (17.933 s) : 17933000, 17933000
.   : milestone, 17933000,
iast_GLOBAL (17.871 s) : 17871000, 17871000
.   : milestone, 17871000,
profiling (14.806 s) : 14806000, 14806000
.   : milestone, 14806000,
tracing (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.888 s [14.888 s, 14.888 s] -
appsec 14.905 s [14.905 s, 14.905 s] 17.0 ms (0.1%)
iast 18.135 s [18.135 s, 18.135 s] 3.247 s (21.8%)
iast_GLOBAL 17.896 s [17.896 s, 17.896 s] 3.008 s (20.2%)
profiling 14.924 s [14.924 s, 14.924 s] 36.0 ms (0.2%)
tracing 14.799 s [14.799 s, 14.799 s] -89.0 ms (-0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.553 s [15.553 s, 15.553 s] -
appsec 14.689 s [14.689 s, 14.689 s] -864.0 ms (-5.6%)
iast 17.933 s [17.933 s, 17.933 s] 2.38 s (15.3%)
iast_GLOBAL 17.871 s [17.871 s, 17.871 s] 2.318 s (14.9%)
profiling 14.806 s [14.806 s, 14.806 s] -747.0 ms (-4.8%)
tracing 14.983 s [14.983 s, 14.983 s] -570.0 ms (-3.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~0cb068786f, baseline=1.61.0-SNAPSHOT~1abe140bde
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.513 ms) : 2458, 2567
.   : milestone, 2513,
iast (2.262 ms) : 2193, 2331
.   : milestone, 2262,
iast_GLOBAL (2.297 ms) : 2228, 2367
.   : milestone, 2297,
profiling (2.529 ms) : 2364, 2694
.   : milestone, 2529,
tracing (2.069 ms) : 2015, 2123
.   : milestone, 2069,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.79 ms) : 3565, 4015
.   : milestone, 3790,
iast (2.269 ms) : 2199, 2339
.   : milestone, 2269,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.092 ms) : 2037, 2147
.   : milestone, 2092,
tracing (2.07 ms) : 2016, 2124
.   : milestone, 2070,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.513 ms [2.458 ms, 2.567 ms] 1.039 ms (70.5%)
iast 2.262 ms [2.193 ms, 2.331 ms] 788.423 µs (53.5%)
iast_GLOBAL 2.297 ms [2.228 ms, 2.367 ms] 823.783 µs (55.9%)
profiling 2.529 ms [2.364 ms, 2.694 ms] 1.055 ms (71.6%)
tracing 2.069 ms [2.015 ms, 2.123 ms] 595.687 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.79 ms [3.565 ms, 4.015 ms] 2.322 ms (158.1%)
iast 2.269 ms [2.199 ms, 2.339 ms] 800.53 µs (54.5%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.368 ms] 829.985 µs (56.5%)
profiling 2.092 ms [2.037 ms, 2.147 ms] 623.642 µs (42.5%)
tracing 2.07 ms [2.016 ms, 2.124 ms] 601.876 µs (41.0%)

@aboitreaud aboitreaud mentioned this pull request Mar 27, 2026
Merged
@aboitreaud aboitreaud added inst: apache spark Apache Spark instrumentation type: bug Bug report and fix labels Mar 30, 2026
@aboitreaud aboitreaud marked this pull request as ready for review March 30, 2026 07:39
@aboitreaud aboitreaud requested a review from a team as a code owner March 30, 2026 07:39
pawel-big-lebowski
pawel-big-lebowski approved these changes Mar 30, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

@pawel-big-lebowski pawel-big-lebowski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide more meaningful PR description

@aboitreaud
Copy link
Copy Markdown
Contributor Author

aboitreaud commented Mar 30, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 bot commented Mar 30, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-03-30 08:07:09 UTC ℹ️ Start processing command /merge

2026-03-30 08:07:19 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-03-30 09:11:21 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit 5090952 into master Mar 30, 2026
581 of 583 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the adrien.boitreaud/use-seq-to-fix-emr-support branch March 30, 2026 09:11
@github-actions github-actions bot added this to the 1.61.0 milestone Mar 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pawel-big-lebowski pawel-big-lebowski pawel-big-lebowski approved these changes

Assignees

No one assigned

Labels

inst: apache spark Apache Spark instrumentation type: bug Bug report and fix

Projects

None yet

Milestone

1.61.0

Development

Successfully merging this pull request may close these issues.

2 participants

@aboitreaud @pawel-big-lebowski