Skip to content

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Oct 13, 2025

What Does This Do

Bump Groovy: 3.0.25 -> 4.0.29

Motivation

  • Groovy 4 is the actively supported version, unlike Groovy 3 which is in maintenance mode.
  • It provides first-class support for modern Java versions (JDK 17+).
  • Performance, compilation speed, and static type checking are improved and more predictable.
  • Test code benefits from better IDE support, fewer Groovy–Java interop issues, and more stable behavior on new JDKs.
  • Gradle 9.x is using Groovy 4 OOTB.

Additional Notes

The PR remains relatively small in scope.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Oct 13, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Oct 13, 2025
@pr-commenter
Copy link

pr-commenter bot commented Oct 13, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/groovy-4
git_commit_date 1768410165 1768418956
git_commit_sha 931c409 09d4f71
release_version 1.59.0-SNAPSHOT~931c40963a 1.55.0-SNAPSHOT~09d4f71835
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768420864 1768420864
ci_job_id 1351110799 1351110799
ci_pipeline_id 90765955 90765955
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-d6djo303 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-d6djo303 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084698
Total [baseline] (8.772 s) : 0, 8772131
Agent [candidate] (1.086 s) : 0, 1086404
Total [candidate] (8.755 s) : 0, 8755370
section iast
Agent [baseline] (1.225 s) : 0, 1224655
Total [baseline] (9.375 s) : 0, 9375491
Agent [candidate] (1.243 s) : 0, 1242770
Total [candidate] (9.367 s) : 0, 9366859
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.225 s 139.958 ms (12.9%)
Total tracing 8.772 s -
Total iast 9.375 s 603.359 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent iast 1.243 s 156.366 ms (14.4%)
Total tracing 8.755 s -
Total iast 9.367 s 611.489 ms (7.0%)
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (651.481 ms) : 0, 651481
BytebuddyAgent [candidate] (651.929 ms) : 0, 651929
GlobalTracer [baseline] (282.693 ms) : 0, 282693
GlobalTracer [candidate] (283.566 ms) : 0, 283566
AppSec [baseline] (32.632 ms) : 0, 32632
AppSec [candidate] (32.754 ms) : 0, 32754
Debugger [baseline] (67.579 ms) : 0, 67579
Debugger [candidate] (67.645 ms) : 0, 67645
Remote Config [baseline] (658.533 µs) : 0, 659
Remote Config [candidate] (649.336 µs) : 0, 649
Telemetry [baseline] (9.017 ms) : 0, 9017
Telemetry [candidate] (9.139 ms) : 0, 9139
Flare Poller [baseline] (3.826 ms) : 0, 3826
Flare Poller [candidate] (3.893 ms) : 0, 3893
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (792.386 ms) : 0, 792386
BytebuddyAgent [candidate] (804.676 ms) : 0, 804676
GlobalTracer [baseline] (256.753 ms) : 0, 256753
GlobalTracer [candidate] (260.176 ms) : 0, 260176
IAST [baseline] (27.046 ms) : 0, 27046
IAST [candidate] (27.401 ms) : 0, 27401
AppSec [baseline] (32.484 ms) : 0, 32484
AppSec [candidate] (34.808 ms) : 0, 34808
Debugger [baseline] (66.665 ms) : 0, 66665
Debugger [candidate] (65.561 ms) : 0, 65561
Remote Config [baseline] (575.217 µs) : 0, 575
Remote Config [candidate] (609.088 µs) : 0, 609
Telemetry [baseline] (8.406 ms) : 0, 8406
Telemetry [candidate] (8.685 ms) : 0, 8685
Flare Poller [baseline] (3.56 ms) : 0, 3560
Flare Poller [candidate] (3.67 ms) : 0, 3670
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1086163
Total [baseline] (10.938 s) : 0, 10938398
Agent [candidate] (1.09 s) : 0, 1090035
Total [candidate] (10.823 s) : 0, 10823087
section appsec
Agent [baseline] (1.267 s) : 0, 1267368
Total [baseline] (11.051 s) : 0, 11051247
Agent [candidate] (1.265 s) : 0, 1265316
Total [candidate] (11.069 s) : 0, 11068913
section iast
Agent [baseline] (1.226 s) : 0, 1226409
Total [baseline] (11.209 s) : 0, 11208847
Agent [candidate] (1.23 s) : 0, 1230428
Total [candidate] (11.259 s) : 0, 11259045
section profiling
Agent [baseline] (1.211 s) : 0, 1210812
Total [baseline] (10.933 s) : 0, 10933466
Agent [candidate] (1.21 s) : 0, 1210278
Total [candidate] (10.886 s) : 0, 10886279
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.267 s 181.205 ms (16.7%)
Agent iast 1.226 s 140.246 ms (12.9%)
Agent profiling 1.211 s 124.649 ms (11.5%)
Total tracing 10.938 s -
Total appsec 11.051 s 112.849 ms (1.0%)
Total iast 11.209 s 270.45 ms (2.5%)
Total profiling 10.933 s -4.932 ms (-0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.265 s 175.28 ms (16.1%)
Agent iast 1.23 s 140.393 ms (12.9%)
Agent profiling 1.21 s 120.243 ms (11.0%)
Total tracing 10.823 s -
Total appsec 11.069 s 245.826 ms (2.3%)
Total iast 11.259 s 435.958 ms (4.0%)
Total profiling 10.886 s 63.192 ms (0.6%)
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (652.073 ms) : 0, 652073
BytebuddyAgent [candidate] (654.87 ms) : 0, 654870
GlobalTracer [baseline] (282.841 ms) : 0, 282841
GlobalTracer [candidate] (283.425 ms) : 0, 283425
AppSec [baseline] (32.693 ms) : 0, 32693
AppSec [candidate] (32.826 ms) : 0, 32826
Debugger [baseline] (67.397 ms) : 0, 67397
Debugger [candidate] (68.427 ms) : 0, 68427
Remote Config [baseline] (644.511 µs) : 0, 645
Remote Config [candidate] (625.627 µs) : 0, 626
Telemetry [baseline] (9.147 ms) : 0, 9147
Telemetry [candidate] (9.141 ms) : 0, 9141
Flare Poller [baseline] (4.655 ms) : 0, 4655
Flare Poller [candidate] (3.891 ms) : 0, 3891
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (691.489 ms) : 0, 691489
BytebuddyAgent [candidate] (691.412 ms) : 0, 691412
GlobalTracer [baseline] (258.892 ms) : 0, 258892
GlobalTracer [candidate] (258.594 ms) : 0, 258594
IAST [baseline] (24.715 ms) : 0, 24715
IAST [candidate] (24.591 ms) : 0, 24591
AppSec [baseline] (173.29 ms) : 0, 173290
AppSec [candidate] (171.815 ms) : 0, 171815
Debugger [baseline] (68.29 ms) : 0, 68290
Debugger [candidate] (67.923 ms) : 0, 67923
Remote Config [baseline] (791.863 µs) : 0, 792
Remote Config [candidate] (817.765 µs) : 0, 818
Telemetry [baseline] (9.511 ms) : 0, 9511
Telemetry [candidate] (9.628 ms) : 0, 9628
Flare Poller [baseline] (3.754 ms) : 0, 3754
Flare Poller [candidate] (3.853 ms) : 0, 3853
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (792.633 ms) : 0, 792633
BytebuddyAgent [candidate] (794.34 ms) : 0, 794340
GlobalTracer [baseline] (256.823 ms) : 0, 256823
GlobalTracer [candidate] (257.604 ms) : 0, 257604
IAST [baseline] (27.243 ms) : 0, 27243
IAST [candidate] (27.194 ms) : 0, 27194
AppSec [baseline] (34.701 ms) : 0, 34701
AppSec [candidate] (34.628 ms) : 0, 34628
Debugger [baseline] (65.632 ms) : 0, 65632
Debugger [candidate] (66.894 ms) : 0, 66894
Remote Config [baseline] (613.961 µs) : 0, 614
Remote Config [candidate] (602.807 µs) : 0, 603
Telemetry [baseline] (8.454 ms) : 0, 8454
Telemetry [candidate] (8.675 ms) : 0, 8675
Flare Poller [baseline] (3.528 ms) : 0, 3528
Flare Poller [candidate] (3.66 ms) : 0, 3660
section profiling
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.231 ms) : 0, 1231
BytebuddyAgent [baseline] (706.827 ms) : 0, 706827
BytebuddyAgent [candidate] (704.881 ms) : 0, 704881
GlobalTracer [baseline] (221.7 ms) : 0, 221700
GlobalTracer [candidate] (221.766 ms) : 0, 221766
AppSec [baseline] (32.158 ms) : 0, 32158
AppSec [candidate] (32.179 ms) : 0, 32179
Debugger [baseline] (68.347 ms) : 0, 68347
Debugger [candidate] (68.52 ms) : 0, 68520
Remote Config [baseline] (668.905 µs) : 0, 669
Remote Config [candidate] (646.716 µs) : 0, 647
Telemetry [baseline] (9.099 ms) : 0, 9099
Telemetry [candidate] (9.081 ms) : 0, 9081
Flare Poller [baseline] (3.83 ms) : 0, 3830
Flare Poller [candidate] (3.804 ms) : 0, 3804
ProfilingAgent [baseline] (96.618 ms) : 0, 96618
ProfilingAgent [candidate] (98.007 ms) : 0, 98007
Profiling [baseline] (97.199 ms) : 0, 97199
Profiling [candidate] (98.601 ms) : 0, 98601
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/groovy-4
git_commit_date 1768410165 1768418956
git_commit_sha 931c409 09d4f71
release_version 1.59.0-SNAPSHOT~931c40963a 1.55.0-SNAPSHOT~09d4f71835
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768421360 1768421360
ci_job_id 1351110800 1351110800
ci_pipeline_id 90765955 90765955
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-crsrqc26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-crsrqc26 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+92.682µs; +211.733µs] or [+3.423%; +7.819%]
unsure
[+35.558µs; +551.026µs] or [+0.457%; +7.081%]
unstable
[-215.164op/s; +76.601op/s] or [-16.158%; +5.752%]
2.860ms 8.075ms 1262.344op/s 2.708ms 7.782ms 1331.625op/s
scenario:load:insecure-bank:profiling:high_load better
[-176.334µs; -37.427µs] or [-10.151%; -2.155%]
unstable
[-1417.961µs; -209.325µs] or [-26.188%; -3.866%]
unstable
[-39.264op/s; +487.577op/s] or [-1.909%; +23.706%]
1.630ms 4.601ms 2280.938op/s 1.737ms 5.415ms 2056.781op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.943 ms) : 17764, 18123
.   : milestone, 17943,
appsec (18.546 ms) : 18359, 18734
.   : milestone, 18546,
code_origins (17.721 ms) : 17545, 17897
.   : milestone, 17721,
iast (17.534 ms) : 17360, 17709
.   : milestone, 17534,
profiling (18.735 ms) : 18545, 18925
.   : milestone, 18735,
tracing (17.779 ms) : 17602, 17957
.   : milestone, 17779,
section candidate
no_agent (18.899 ms) : 18703, 19094
.   : milestone, 18899,
appsec (18.697 ms) : 18507, 18887
.   : milestone, 18697,
code_origins (17.908 ms) : 17729, 18086
.   : milestone, 17908,
iast (17.493 ms) : 17321, 17666
.   : milestone, 17493,
profiling (18.495 ms) : 18310, 18681
.   : milestone, 18495,
tracing (17.655 ms) : 17479, 17832
.   : milestone, 17655,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.943 ms [17.764 ms, 18.123 ms] -
appsec 18.546 ms [18.359 ms, 18.734 ms] 602.682 µs (3.4%)
code_origins 17.721 ms [17.545 ms, 17.897 ms] -222.773 µs (-1.2%)
iast 17.534 ms [17.36 ms, 17.709 ms] -409.123 µs (-2.3%)
profiling 18.735 ms [18.545 ms, 18.925 ms] 791.508 µs (4.4%)
tracing 17.779 ms [17.602 ms, 17.957 ms] -164.067 µs (-0.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.899 ms [18.703 ms, 19.094 ms] -
appsec 18.697 ms [18.507 ms, 18.887 ms] -201.619 µs (-1.1%)
code_origins 17.908 ms [17.729 ms, 18.086 ms] -990.946 µs (-5.2%)
iast 17.493 ms [17.321 ms, 17.666 ms] -1.405 ms (-7.4%)
profiling 18.495 ms [18.31 ms, 18.681 ms] -403.462 µs (-2.1%)
tracing 17.655 ms [17.479 ms, 17.832 ms] -1.243 ms (-6.6%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.182 ms) : 1170, 1194
.   : milestone, 1182,
iast (3.244 ms) : 3200, 3288
.   : milestone, 3244,
iast_FULL (5.662 ms) : 5608, 5717
.   : milestone, 5662,
iast_GLOBAL (3.442 ms) : 3392, 3491
.   : milestone, 3442,
profiling (2.201 ms) : 2181, 2221
.   : milestone, 2201,
tracing (1.82 ms) : 1804, 1835
.   : milestone, 1820,
section candidate
no_agent (1.185 ms) : 1173, 1196
.   : milestone, 1185,
iast (3.274 ms) : 3233, 3315
.   : milestone, 3274,
iast_FULL (5.529 ms) : 5475, 5582
.   : milestone, 5529,
iast_GLOBAL (3.632 ms) : 3572, 3693
.   : milestone, 3632,
profiling (1.978 ms) : 1960, 1995
.   : milestone, 1978,
tracing (1.861 ms) : 1844, 1878
.   : milestone, 1861,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.182 ms [1.17 ms, 1.194 ms] -
iast 3.244 ms [3.2 ms, 3.288 ms] 2.062 ms (174.4%)
iast_FULL 5.662 ms [5.608 ms, 5.717 ms] 4.48 ms (379.0%)
iast_GLOBAL 3.442 ms [3.392 ms, 3.491 ms] 2.259 ms (191.1%)
profiling 2.201 ms [2.181 ms, 2.221 ms] 1.019 ms (86.2%)
tracing 1.82 ms [1.804 ms, 1.835 ms] 637.429 µs (53.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.196 ms] -
iast 3.274 ms [3.233 ms, 3.315 ms] 2.089 ms (176.4%)
iast_FULL 5.529 ms [5.475 ms, 5.582 ms] 4.344 ms (366.7%)
iast_GLOBAL 3.632 ms [3.572 ms, 3.693 ms] 2.448 ms (206.6%)
profiling 1.978 ms [1.96 ms, 1.995 ms] 792.89 µs (66.9%)
tracing 1.861 ms [1.844 ms, 1.878 ms] 676.182 µs (57.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/groovy-4
git_commit_date 1768410165 1768418956
git_commit_sha 931c409 09d4f71
release_version 1.59.0-SNAPSHOT~931c40963a 1.55.0-SNAPSHOT~09d4f71835
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768421086 1768421086
ci_job_id 1351110801 1351110801
ci_pipeline_id 90765955 90765955
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-p43ffnfm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-p43ffnfm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.646 s) : 14646000, 14646000
.   : milestone, 14646000,
appsec (14.941 s) : 14941000, 14941000
.   : milestone, 14941000,
iast (18.307 s) : 18307000, 18307000
.   : milestone, 18307000,
iast_GLOBAL (17.897 s) : 17897000, 17897000
.   : milestone, 17897000,
profiling (14.833 s) : 14833000, 14833000
.   : milestone, 14833000,
tracing (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
section candidate
no_agent (15.687 s) : 15687000, 15687000
.   : milestone, 15687000,
appsec (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
iast (18.223 s) : 18223000, 18223000
.   : milestone, 18223000,
iast_GLOBAL (17.544 s) : 17544000, 17544000
.   : milestone, 17544000,
profiling (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
tracing (14.675 s) : 14675000, 14675000
.   : milestone, 14675000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.646 s [14.646 s, 14.646 s] -
appsec 14.941 s [14.941 s, 14.941 s] 295.0 ms (2.0%)
iast 18.307 s [18.307 s, 18.307 s] 3.661 s (25.0%)
iast_GLOBAL 17.897 s [17.897 s, 17.897 s] 3.251 s (22.2%)
profiling 14.833 s [14.833 s, 14.833 s] 187.0 ms (1.3%)
tracing 14.84 s [14.84 s, 14.84 s] 194.0 ms (1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.687 s [15.687 s, 15.687 s] -
appsec 14.738 s [14.738 s, 14.738 s] -949.0 ms (-6.0%)
iast 18.223 s [18.223 s, 18.223 s] 2.536 s (16.2%)
iast_GLOBAL 17.544 s [17.544 s, 17.544 s] 1.857 s (11.8%)
profiling 15.089 s [15.089 s, 15.089 s] -598.0 ms (-3.8%)
tracing 14.675 s [14.675 s, 14.675 s] -1.012 s (-6.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~09d4f71835, baseline=1.59.0-SNAPSHOT~931c40963a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.727 ms) : 3506, 3949
.   : milestone, 3727,
iast (2.221 ms) : 2156, 2286
.   : milestone, 2221,
iast_GLOBAL (2.26 ms) : 2195, 2326
.   : milestone, 2260,
profiling (2.491 ms) : 2281, 2700
.   : milestone, 2491,
tracing (2.048 ms) : 1997, 2100
.   : milestone, 2048,
section candidate
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (3.725 ms) : 3504, 3947
.   : milestone, 3725,
iast (2.219 ms) : 2153, 2284
.   : milestone, 2219,
iast_GLOBAL (2.261 ms) : 2196, 2326
.   : milestone, 2261,
profiling (2.062 ms) : 2009, 2114
.   : milestone, 2062,
tracing (2.046 ms) : 1995, 2097
.   : milestone, 2046,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.727 ms [3.506 ms, 3.949 ms] 2.251 ms (152.6%)
iast 2.221 ms [2.156 ms, 2.286 ms] 745.365 µs (50.5%)
iast_GLOBAL 2.26 ms [2.195 ms, 2.326 ms] 784.387 µs (53.1%)
profiling 2.491 ms [2.281 ms, 2.7 ms] 1.015 ms (68.8%)
tracing 2.048 ms [1.997 ms, 2.1 ms] 572.419 µs (38.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 3.725 ms [3.504 ms, 3.947 ms] 2.247 ms (152.0%)
iast 2.219 ms [2.153 ms, 2.284 ms] 740.698 µs (50.1%)
iast_GLOBAL 2.261 ms [2.196 ms, 2.326 ms] 783.13 µs (53.0%)
profiling 2.062 ms [2.009 ms, 2.114 ms] 583.724 µs (39.5%)
tracing 2.046 ms [1.995 ms, 2.097 ms] 568.115 µs (38.4%)

@pr-commenter
Copy link

pr-commenter bot commented Oct 25, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/groovy-4
git_commit_date 1766094198 1766103948
git_commit_sha 45bc239 71c1ad1
See matching parameters
Baseline Candidate
ci_job_date 1766105212 1766105212
ci_job_id 1308344508 1308344508
ci_pipeline_id 87704257 87704257
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Oct 25, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/groovy-4
git_commit_date 1767612653 1767618465
git_commit_sha 54b60b0 7fc79c1
See matching parameters
Baseline Candidate
ci_job_date 1767621008 1767621008
ci_job_id 1326476583 1326476583
ci_pipeline_id 88913142 88913142
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-11783.732op/s; -1545.284op/s] or [-3.793%; -0.497%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@datadog-datadog-prod-us1

This comment has been minimized.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 14, 2026

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added type: refactoring comp: tooling Build & Tooling and removed tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Jan 14, 2026
Copy link
Contributor

@sarahchen6 sarahchen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants