Skip to content

Enable merge queue #10002

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
sarahchen6 wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Enable merge queue #10002

sarahchen6 wants to merge 4 commits into from
+13 −2

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Nov 19, 2025 •
edited
Loading

What Does This Do

Enable a merge queue, and include the following configurations:

  • Merge using the squash method
  • Allow skipping merge queue checks for master, but require a reason for skipping these checks
    • This configuration is included as an extra precaution in case we need to override the merge queue, but it should be avoided because it defeats the purpose of a merge queue and would skip any checks specific to merge queues
  • Require the PR to have at least one label
  • Require the PR's commits to be signed
  • Require the PR to have all necessary reviews

Motivation

By enabling a merge queue, not only can we ensure that PRs pass CI with the latest version of master, including all PRs merged before it, but also we can run certain checks (e.g. benchmarks) only when merging to master. Merge queues by default run with the "speculative" workflow type. More details here, but TLDR; each PR needs to pass with the latest version of master + any PRs that sit before it in the merge queue before being merged.

For now, we will start by enabling just the merge queue, keeping all PR checks as-is. If this is successful, we can start tailoring merge queue-specific checks.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 19, 2025
@PerfectSlayer
Copy link
Contributor

PerfectSlayer commented Nov 20, 2025

Instead we can run benchmarks when manually triggered and merging to master through a merge queue. The check-big-regressions PR-gate would prevent large regressions from being merged to master, but it would be the responsibility of the developer to run benchmarks when relevant prior to putting their PR in the merge queue.

Would there be a way for benchmarks to excluded on purpose rather than opt-in? I guess big regression would catch most of the issues, but I would think that casual offenders introduce regression because their don't know about it, so they would not opt into benchmarks in the first place?
That's a discussion we can have with the guild :)

@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Nov 20, 2025

Would there be a way for benchmarks to excluded on purpose rather than opt-in?

@PerfectSlayer Yes we can also do that! Perhaps we could run a longer, more stable benchmark in the merge queue and still have some benchmarks run on every push 🤔

That's a discussion we can have with the guild :)

Agreed! I'll wait for a Guild discussion before proceeding any further

@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/enable-merge-queue
git_commit_date 1769179884 1769191001
git_commit_sha c6c245f 1fd8381
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.56.0-SNAPSHOT~1fd83812e1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769192849 1769192849
ci_job_id 1373899446 1373899446
ci_pipeline_id 92548160 92548160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-6l3q2iqi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-6l3q2iqi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1087932
Total [baseline] (8.786 s) : 0, 8786222
Agent [candidate] (1.09 s) : 0, 1089638
Total [candidate] (8.738 s) : 0, 8738168
section iast
Agent [baseline] (1.235 s) : 0, 1235431
Total [baseline] (9.319 s) : 0, 9319040
Agent [candidate] (1.236 s) : 0, 1235881
Total [candidate] (9.281 s) : 0, 9280740
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.235 s 147.499 ms (13.6%)
Total tracing 8.786 s -
Total iast 9.319 s 532.819 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.236 s 146.243 ms (13.4%)
Total tracing 8.738 s -
Total iast 9.281 s 542.572 ms (6.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (651.955 ms) : 0, 651955
BytebuddyAgent [candidate] (652.886 ms) : 0, 652886
GlobalTracer [baseline] (285.782 ms) : 0, 285782
GlobalTracer [candidate] (286.74 ms) : 0, 286740
AppSec [baseline] (33.03 ms) : 0, 33030
AppSec [candidate] (32.794 ms) : 0, 32794
Debugger [baseline] (67.155 ms) : 0, 67155
Debugger [candidate] (66.521 ms) : 0, 66521
Remote Config [baseline] (613.408 µs) : 0, 613
Remote Config [candidate] (607.4 µs) : 0, 607
Telemetry [baseline] (8.952 ms) : 0, 8952
Telemetry [candidate] (8.924 ms) : 0, 8924
Flare Poller [baseline] (3.751 ms) : 0, 3751
Flare Poller [candidate] (4.502 ms) : 0, 4502
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (798.388 ms) : 0, 798388
BytebuddyAgent [candidate] (800.127 ms) : 0, 800127
GlobalTracer [baseline] (260.421 ms) : 0, 260421
GlobalTracer [candidate] (260.007 ms) : 0, 260007
IAST [baseline] (27.242 ms) : 0, 27242
IAST [candidate] (27.078 ms) : 0, 27078
AppSec [baseline] (35.414 ms) : 0, 35414
AppSec [candidate] (34.22 ms) : 0, 34220
Debugger [baseline] (64.595 ms) : 0, 64595
Debugger [candidate] (65.294 ms) : 0, 65294
Remote Config [baseline] (544.787 µs) : 0, 545
Remote Config [candidate] (533.077 µs) : 0, 533
Telemetry [baseline] (8.577 ms) : 0, 8577
Telemetry [candidate] (8.453 ms) : 0, 8453
Flare Poller [baseline] (3.522 ms) : 0, 3522
Flare Poller [candidate] (3.444 ms) : 0, 3444
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1089534
Total [baseline] (10.761 s) : 0, 10760647
Agent [candidate] (1.09 s) : 0, 1089925
Total [candidate] (10.793 s) : 0, 10792891
section appsec
Agent [baseline] (1.269 s) : 0, 1268710
Total [baseline] (11.014 s) : 0, 11013757
Agent [candidate] (1.271 s) : 0, 1271008
Total [candidate] (11.084 s) : 0, 11083904
section iast
Agent [baseline] (1.23 s) : 0, 1229846
Total [baseline] (11.188 s) : 0, 11187686
Agent [candidate] (1.226 s) : 0, 1225926
Total [candidate] (11.131 s) : 0, 11130613
section profiling
Agent [baseline] (1.205 s) : 0, 1205126
Total [baseline] (10.856 s) : 0, 10856132
Agent [candidate] (1.204 s) : 0, 1204492
Total [candidate] (10.905 s) : 0, 10904903
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.269 s 179.177 ms (16.4%)
Agent iast 1.23 s 140.312 ms (12.9%)
Agent profiling 1.205 s 115.592 ms (10.6%)
Total tracing 10.761 s -
Total appsec 11.014 s 253.11 ms (2.4%)
Total iast 11.188 s 427.039 ms (4.0%)
Total profiling 10.856 s 95.485 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.271 s 181.084 ms (16.6%)
Agent iast 1.226 s 136.001 ms (12.5%)
Agent profiling 1.204 s 114.567 ms (10.5%)
Total tracing 10.793 s -
Total appsec 11.084 s 291.013 ms (2.7%)
Total iast 11.131 s 337.723 ms (3.1%)
Total profiling 10.905 s 112.013 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.168 ms) : 0, 1168
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (652.489 ms) : 0, 652489
BytebuddyAgent [candidate] (653.46 ms) : 0, 653460
GlobalTracer [baseline] (286.315 ms) : 0, 286315
GlobalTracer [candidate] (286.025 ms) : 0, 286025
AppSec [baseline] (33.057 ms) : 0, 33057
AppSec [candidate] (32.729 ms) : 0, 32729
Debugger [baseline] (67.883 ms) : 0, 67883
Debugger [candidate] (66.93 ms) : 0, 66930
Remote Config [baseline] (596.583 µs) : 0, 597
Remote Config [candidate] (599.161 µs) : 0, 599
Telemetry [baseline] (8.849 ms) : 0, 8849
Telemetry [candidate] (8.896 ms) : 0, 8896
Flare Poller [baseline] (3.746 ms) : 0, 3746
Flare Poller [candidate] (4.535 ms) : 0, 4535
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (691.352 ms) : 0, 691352
BytebuddyAgent [candidate] (692.576 ms) : 0, 692576
GlobalTracer [baseline] (262.234 ms) : 0, 262234
GlobalTracer [candidate] (262.786 ms) : 0, 262786
IAST [baseline] (24.759 ms) : 0, 24759
IAST [candidate] (24.931 ms) : 0, 24931
AppSec [baseline] (174.071 ms) : 0, 174071
AppSec [candidate] (173.05 ms) : 0, 173050
Debugger [baseline] (65.975 ms) : 0, 65975
Debugger [candidate] (67.223 ms) : 0, 67223
Remote Config [baseline] (696.994 µs) : 0, 697
Remote Config [candidate] (684.314 µs) : 0, 684
Telemetry [baseline] (9.38 ms) : 0, 9380
Telemetry [candidate] (9.429 ms) : 0, 9429
Flare Poller [baseline] (3.689 ms) : 0, 3689
Flare Poller [candidate] (3.727 ms) : 0, 3727
section iast
crashtracking [baseline] (1.173 ms) : 0, 1173
crashtracking [candidate] (1.167 ms) : 0, 1167
BytebuddyAgent [baseline] (793.78 ms) : 0, 793780
BytebuddyAgent [candidate] (790.931 ms) : 0, 790931
GlobalTracer [baseline] (259.529 ms) : 0, 259529
GlobalTracer [candidate] (258.564 ms) : 0, 258564
IAST [baseline] (27.038 ms) : 0, 27038
IAST [candidate] (26.873 ms) : 0, 26873
AppSec [baseline] (33.422 ms) : 0, 33422
AppSec [candidate] (34.453 ms) : 0, 34453
Debugger [baseline] (67.073 ms) : 0, 67073
Debugger [candidate] (66.053 ms) : 0, 66053
Remote Config [baseline] (545.119 µs) : 0, 545
Remote Config [candidate] (555.975 µs) : 0, 556
Telemetry [baseline] (8.486 ms) : 0, 8486
Telemetry [candidate] (8.532 ms) : 0, 8532
Flare Poller [baseline] (3.436 ms) : 0, 3436
Flare Poller [candidate] (3.499 ms) : 0, 3499
section profiling
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (700.302 ms) : 0, 700302
BytebuddyAgent [candidate] (700.36 ms) : 0, 700360
GlobalTracer [baseline] (224.199 ms) : 0, 224199
GlobalTracer [candidate] (224.46 ms) : 0, 224460
AppSec [baseline] (32.28 ms) : 0, 32280
AppSec [candidate] (32.329 ms) : 0, 32329
Debugger [baseline] (67.9 ms) : 0, 67900
Debugger [candidate] (67.46 ms) : 0, 67460
Remote Config [baseline] (607.163 µs) : 0, 607
Remote Config [candidate] (604.903 µs) : 0, 605
Telemetry [baseline] (8.78 ms) : 0, 8780
Telemetry [candidate] (8.775 ms) : 0, 8775
Flare Poller [baseline] (3.651 ms) : 0, 3651
Flare Poller [candidate] (3.571 ms) : 0, 3571
ProfilingAgent [baseline] (96.432 ms) : 0, 96432
ProfilingAgent [candidate] (96.059 ms) : 0, 96059
Profiling [baseline] (97.019 ms) : 0, 97019
Profiling [candidate] (96.632 ms) : 0, 96632
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/enable-merge-queue
git_commit_date 1769179884 1769191001
git_commit_sha c6c245f 1fd8381
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.56.0-SNAPSHOT~1fd83812e1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769193351 1769193351
ci_job_id 1373899448 1373899448
ci_pipeline_id 92548160 92548160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-8fk0lb2j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-8fk0lb2j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+86.828µs; +152.791µs] or [+3.573%; +6.287%]		 worse
[+194.994µs; +612.218µs] or [+2.736%; +8.590%]		 unstable
[-220.525op/s; +72.213op/s] or [-15.107%; +4.947%]		 2.550ms 7.531ms 1385.625op/s 2.430ms 7.127ms 1459.781op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.674ms; +1.777ms] or [+3.892%; +10.257%]		 same
[-121.356µs; +2050.013µs] or [-0.417%; +7.044%]		 unstable
[-40.845op/s; +11.033op/s] or [-15.678%; +4.235%]		 18.549ms 30.068ms 245.625op/s 17.323ms 29.104ms 260.531op/s
scenario:load:petclinic:code_origins:high_load better
[-1.474ms; -0.555ms] or [-8.091%; -3.045%]		 better
[-2.332ms; -0.839ms] or [-7.796%; -2.804%]		 unstable
[-12.088op/s; +39.838op/s] or [-4.803%; +15.830%]		 17.199ms 28.335ms 265.531op/s 18.213ms 29.920ms 251.656op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.199 ms) : 1187, 1211
.   : milestone, 1199,
iast (3.133 ms) : 3092, 3174
.   : milestone, 3133,
iast_FULL (5.727 ms) : 5670, 5784
.   : milestone, 5727,
iast_GLOBAL (3.601 ms) : 3541, 3661
.   : milestone, 3601,
profiling (2.107 ms) : 2086, 2127
.   : milestone, 2107,
tracing (1.847 ms) : 1831, 1863
.   : milestone, 1847,
section candidate
no_agent (1.184 ms) : 1172, 1195
.   : milestone, 1184,
iast (3.303 ms) : 3257, 3348
.   : milestone, 3303,
iast_FULL (5.991 ms) : 5929, 6052
.   : milestone, 5991,
iast_GLOBAL (3.591 ms) : 3541, 3640
.   : milestone, 3591,
profiling (1.96 ms) : 1943, 1977
.   : milestone, 1960,
tracing (1.814 ms) : 1798, 1829
.   : milestone, 1814,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.187 ms, 1.211 ms] -
iast 3.133 ms [3.092 ms, 3.174 ms] 1.934 ms (161.3%)
iast_FULL 5.727 ms [5.67 ms, 5.784 ms] 4.528 ms (377.6%)
iast_GLOBAL 3.601 ms [3.541 ms, 3.661 ms] 2.402 ms (200.3%)
profiling 2.107 ms [2.086 ms, 2.127 ms] 907.472 µs (75.7%)
tracing 1.847 ms [1.831 ms, 1.863 ms] 647.851 µs (54.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.184 ms [1.172 ms, 1.195 ms] -
iast 3.303 ms [3.257 ms, 3.348 ms] 2.119 ms (179.0%)
iast_FULL 5.991 ms [5.929 ms, 6.052 ms] 4.807 ms (406.2%)
iast_GLOBAL 3.591 ms [3.541 ms, 3.64 ms] 2.407 ms (203.4%)
profiling 1.96 ms [1.943 ms, 1.977 ms] 776.302 µs (65.6%)
tracing 1.814 ms [1.798 ms, 1.829 ms] 630.234 µs (53.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.909 ms) : 17731, 18088
.   : milestone, 17909,
appsec (18.987 ms) : 18799, 19175
.   : milestone, 18987,
code_origins (18.542 ms) : 18354, 18730
.   : milestone, 18542,
iast (17.79 ms) : 17612, 17969
.   : milestone, 17790,
profiling (18.772 ms) : 18583, 18962
.   : milestone, 18772,
tracing (17.667 ms) : 17492, 17841
.   : milestone, 17667,
section candidate
no_agent (19.0 ms) : 18813, 19187
.   : milestone, 19000,
appsec (18.732 ms) : 18547, 18917
.   : milestone, 18732,
code_origins (17.569 ms) : 17396, 17743
.   : milestone, 17569,
iast (17.646 ms) : 17468, 17824
.   : milestone, 17646,
profiling (18.78 ms) : 18591, 18970
.   : milestone, 18780,
tracing (17.585 ms) : 17410, 17759
.   : milestone, 17585,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.909 ms [17.731 ms, 18.088 ms] -
appsec 18.987 ms [18.799 ms, 19.175 ms] 1.078 ms (6.0%)
code_origins 18.542 ms [18.354 ms, 18.73 ms] 632.619 µs (3.5%)
iast 17.79 ms [17.612 ms, 17.969 ms] -119.002 µs (-0.7%)
profiling 18.772 ms [18.583 ms, 18.962 ms] 862.943 µs (4.8%)
tracing 17.667 ms [17.492 ms, 17.841 ms] -242.95 µs (-1.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.0 ms [18.813 ms, 19.187 ms] -
appsec 18.732 ms [18.547 ms, 18.917 ms] -267.95 µs (-1.4%)
code_origins 17.569 ms [17.396 ms, 17.743 ms] -1.431 ms (-7.5%)
iast 17.646 ms [17.468 ms, 17.824 ms] -1.354 ms (-7.1%)
profiling 18.78 ms [18.591 ms, 18.97 ms] -219.732 µs (-1.2%)
tracing 17.585 ms [17.41 ms, 17.759 ms] -1.415 ms (-7.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/enable-merge-queue
git_commit_date 1769179884 1769191001
git_commit_sha c6c245f 1fd8381
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.56.0-SNAPSHOT~1fd83812e1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769193057 1769193057
ci_job_id 1373899451 1373899451
ci_pipeline_id 92548160 92548160
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-gf2e4k5e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-gf2e4k5e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.370ms; -1.033ms] or [-37.371%; -28.177%]		 2.465ms 3.667ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.667 ms) : 3452, 3882
.   : milestone, 3667,
iast (2.212 ms) : 2148, 2277
.   : milestone, 2212,
iast_GLOBAL (2.247 ms) : 2181, 2312
.   : milestone, 2247,
profiling (2.064 ms) : 2012, 2117
.   : milestone, 2064,
tracing (2.044 ms) : 1992, 2095
.   : milestone, 2044,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.465 ms) : 2413, 2518
.   : milestone, 2465,
iast (2.209 ms) : 2144, 2274
.   : milestone, 2209,
iast_GLOBAL (2.248 ms) : 2183, 2313
.   : milestone, 2248,
profiling (2.08 ms) : 2025, 2134
.   : milestone, 2080,
tracing (2.05 ms) : 1999, 2102
.   : milestone, 2050,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.667 ms [3.452 ms, 3.882 ms] 2.196 ms (149.3%)
iast 2.212 ms [2.148 ms, 2.277 ms] 741.624 µs (50.4%)
iast_GLOBAL 2.247 ms [2.181 ms, 2.312 ms] 776.082 µs (52.8%)
profiling 2.064 ms [2.012 ms, 2.117 ms] 593.691 µs (40.4%)
tracing 2.044 ms [1.992 ms, 2.095 ms] 573.142 µs (39.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.465 ms [2.413 ms, 2.518 ms] 995.616 µs (67.7%)
iast 2.209 ms [2.144 ms, 2.274 ms] 739.183 µs (50.3%)
iast_GLOBAL 2.248 ms [2.183 ms, 2.313 ms] 778.275 µs (53.0%)
profiling 2.08 ms [2.025 ms, 2.134 ms] 610.191 µs (41.5%)
tracing 2.05 ms [1.999 ms, 2.102 ms] 580.541 µs (39.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~1fd83812e1, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.982 s) : 14982000, 14982000
.   : milestone, 14982000,
appsec (14.607 s) : 14607000, 14607000
.   : milestone, 14607000,
iast (18.087 s) : 18087000, 18087000
.   : milestone, 18087000,
iast_GLOBAL (17.871 s) : 17871000, 17871000
.   : milestone, 17871000,
profiling (14.741 s) : 14741000, 14741000
.   : milestone, 14741000,
tracing (14.596 s) : 14596000, 14596000
.   : milestone, 14596000,
section candidate
no_agent (14.764 s) : 14764000, 14764000
.   : milestone, 14764000,
appsec (14.495 s) : 14495000, 14495000
.   : milestone, 14495000,
iast (18.03 s) : 18030000, 18030000
.   : milestone, 18030000,
iast_GLOBAL (18.026 s) : 18026000, 18026000
.   : milestone, 18026000,
profiling (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
tracing (14.733 s) : 14733000, 14733000
.   : milestone, 14733000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.982 s [14.982 s, 14.982 s] -
appsec 14.607 s [14.607 s, 14.607 s] -375.0 ms (-2.5%)
iast 18.087 s [18.087 s, 18.087 s] 3.105 s (20.7%)
iast_GLOBAL 17.871 s [17.871 s, 17.871 s] 2.889 s (19.3%)
profiling 14.741 s [14.741 s, 14.741 s] -241.0 ms (-1.6%)
tracing 14.596 s [14.596 s, 14.596 s] -386.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.764 s [14.764 s, 14.764 s] -
appsec 14.495 s [14.495 s, 14.495 s] -269.0 ms (-1.8%)
iast 18.03 s [18.03 s, 18.03 s] 3.266 s (22.1%)
iast_GLOBAL 18.026 s [18.026 s, 18.026 s] 3.262 s (22.1%)
profiling 15.001 s [15.001 s, 15.001 s] 237.0 ms (1.6%)
tracing 14.733 s [14.733 s, 14.733 s] -31.0 ms (-0.2%)

@bric3
Copy link
Contributor

bric3 commented Jan 23, 2026 •
edited
Loading

@sarahchen6 Do we need doggo in the browser ? I disabled it, just too many things not working ?

@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Jan 23, 2026 •
edited
Loading

Do we need doggo in the browser ?

@bric3 No doggo isn't necessary - you can interact with the merge queue through comments (ref) as well

@sarahchen6 sarahchen6 marked this pull request as ready for review January 23, 2026 18:19
@sarahchen6 sarahchen6 requested a review from a team as a code owner January 23, 2026 18:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@bric3 bric3 Awaiting requested review from bric3

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@sarahchen6 @PerfectSlayer @bric3 @AlexeyKuznetsov-DD