Skip to content

Conversation

@leoromanovsky
Copy link
Contributor

Motivation

The OpenFeature SDK 1.20.1 includes a fix for empty targeting key handling. This addresses an issue where evaluations with empty targeting keys were not being handled correctly.

Changes

  • Bumped dev.openfeature:sdk from 1.18.2 to 1.20.1 in products/feature-flagging/api/build.gradle.kts
  • Regenerated gradle lockfiles for:
    • products/feature-flagging/api/gradle.lockfile
    • dd-smoke-tests/openfeature/gradle.lockfile

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

This version includes a fix for empty targeting key handling.
@leoromanovsky leoromanovsky added type: bug Bug report and fix comp: openfeature OpenFeature labels Jan 23, 2026
@leoromanovsky leoromanovsky marked this pull request as ready for review January 23, 2026 18:44
@leoromanovsky leoromanovsky requested a review from a team as a code owner January 23, 2026 18:44
@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769195407 1769195407
ci_job_id 1374027656 1374027656
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-s0l6i7x1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-s0l6i7x1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1092995
Total [baseline] (8.801 s) : 0, 8800569
Agent [candidate] (1.09 s) : 0, 1090384
Total [candidate] (8.761 s) : 0, 8760790
section iast
Agent [baseline] (1.24 s) : 0, 1239526
Total [baseline] (9.344 s) : 0, 9344416
Agent [candidate] (1.233 s) : 0, 1233285
Total [candidate] (9.316 s) : 0, 9316304
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent iast 1.24 s 146.531 ms (13.4%)
Total tracing 8.801 s -
Total iast 9.344 s 543.848 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.233 s 142.9 ms (13.1%)
Total tracing 8.761 s -
Total iast 9.316 s 555.514 ms (6.3%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (655.155 ms) : 0, 655155
BytebuddyAgent [candidate] (653.697 ms) : 0, 653697
GlobalTracer [baseline] (286.929 ms) : 0, 286929
GlobalTracer [candidate] (286.626 ms) : 0, 286626
AppSec [baseline] (33.1 ms) : 0, 33100
AppSec [candidate] (32.936 ms) : 0, 32936
Debugger [baseline] (66.721 ms) : 0, 66721
Debugger [candidate] (66.298 ms) : 0, 66298
Remote Config [baseline] (621.371 µs) : 0, 621
Remote Config [candidate] (615.016 µs) : 0, 615
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (8.936 ms) : 0, 8936
Flare Poller [baseline] (4.477 ms) : 0, 4477
Flare Poller [candidate] (4.525 ms) : 0, 4525
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (801.114 ms) : 0, 801114
BytebuddyAgent [candidate] (795.757 ms) : 0, 795757
GlobalTracer [baseline] (261.531 ms) : 0, 261531
GlobalTracer [candidate] (260.752 ms) : 0, 260752
IAST [baseline] (27.358 ms) : 0, 27358
IAST [candidate] (27.079 ms) : 0, 27079
AppSec [baseline] (32.003 ms) : 0, 32003
AppSec [candidate] (32.096 ms) : 0, 32096
Debugger [baseline] (68.159 ms) : 0, 68159
Debugger [candidate] (68.446 ms) : 0, 68446
Remote Config [baseline] (547.005 µs) : 0, 547
Remote Config [candidate] (540.453 µs) : 0, 540
Telemetry [baseline] (8.473 ms) : 0, 8473
Telemetry [candidate] (8.551 ms) : 0, 8551
Flare Poller [baseline] (3.477 ms) : 0, 3477
Flare Poller [candidate] (3.462 ms) : 0, 3462
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1101979
Total [baseline] (10.949 s) : 0, 10949049
Agent [candidate] (1.105 s) : 0, 1105240
Total [candidate] (10.882 s) : 0, 10881667
section appsec
Agent [baseline] (1.274 s) : 0, 1274116
Total [baseline] (11.057 s) : 0, 11057358
Agent [candidate] (1.272 s) : 0, 1271591
Total [candidate] (10.997 s) : 0, 10996547
section iast
Agent [baseline] (1.231 s) : 0, 1231390
Total [baseline] (11.144 s) : 0, 11143591
Agent [candidate] (1.232 s) : 0, 1232439
Total [candidate] (11.238 s) : 0, 11238207
section profiling
Agent [baseline] (1.22 s) : 0, 1219775
Total [baseline] (11.071 s) : 0, 11071371
Agent [candidate] (1.22 s) : 0, 1219593
Total [candidate] (10.958 s) : 0, 10957920
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent appsec 1.274 s 172.137 ms (15.6%)
Agent iast 1.231 s 129.411 ms (11.7%)
Agent profiling 1.22 s 117.796 ms (10.7%)
Total tracing 10.949 s -
Total appsec 11.057 s 108.309 ms (1.0%)
Total iast 11.144 s 194.542 ms (1.8%)
Total profiling 11.071 s 122.322 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.105 s -
Agent appsec 1.272 s 166.351 ms (15.1%)
Agent iast 1.232 s 127.199 ms (11.5%)
Agent profiling 1.22 s 114.354 ms (10.3%)
Total tracing 10.882 s -
Total appsec 10.997 s 114.88 ms (1.1%)
Total iast 11.238 s 356.539 ms (3.3%)
Total profiling 10.958 s 76.252 ms (0.7%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (662.257 ms) : 0, 662257
BytebuddyAgent [candidate] (662.884 ms) : 0, 662884
GlobalTracer [baseline] (288.417 ms) : 0, 288417
GlobalTracer [candidate] (290.137 ms) : 0, 290137
AppSec [baseline] (33.049 ms) : 0, 33049
AppSec [candidate] (33.349 ms) : 0, 33349
Debugger [baseline] (67.855 ms) : 0, 67855
Debugger [candidate] (68.308 ms) : 0, 68308
Remote Config [baseline] (604.364 µs) : 0, 604
Remote Config [candidate] (617.024 µs) : 0, 617
Telemetry [baseline] (8.847 ms) : 0, 8847
Telemetry [candidate] (9.068 ms) : 0, 9068
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.772 ms) : 0, 3772
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (693.982 ms) : 0, 693982
BytebuddyAgent [candidate] (693.98 ms) : 0, 693980
GlobalTracer [baseline] (263.16 ms) : 0, 263160
GlobalTracer [candidate] (262.36 ms) : 0, 262360
IAST [baseline] (24.694 ms) : 0, 24694
IAST [candidate] (24.649 ms) : 0, 24649
AppSec [baseline] (174.933 ms) : 0, 174933
AppSec [candidate] (173.358 ms) : 0, 173358
Debugger [baseline] (66.773 ms) : 0, 66773
Debugger [candidate] (66.713 ms) : 0, 66713
Remote Config [baseline] (696.841 µs) : 0, 697
Remote Config [candidate] (699.449 µs) : 0, 699
Telemetry [baseline] (9.475 ms) : 0, 9475
Telemetry [candidate] (9.379 ms) : 0, 9379
Flare Poller [baseline] (3.62 ms) : 0, 3620
Flare Poller [candidate] (3.621 ms) : 0, 3621
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (794.777 ms) : 0, 794777
BytebuddyAgent [candidate] (795.594 ms) : 0, 795594
GlobalTracer [baseline] (260.274 ms) : 0, 260274
GlobalTracer [candidate] (260.4 ms) : 0, 260400
IAST [baseline] (26.936 ms) : 0, 26936
IAST [candidate] (27.161 ms) : 0, 27161
AppSec [baseline] (35.049 ms) : 0, 35049
AppSec [candidate] (35.137 ms) : 0, 35137
Debugger [baseline] (65.144 ms) : 0, 65144
Debugger [candidate] (64.857 ms) : 0, 64857
Remote Config [baseline] (540.343 µs) : 0, 540
Remote Config [candidate] (541.639 µs) : 0, 542
Telemetry [baseline] (8.483 ms) : 0, 8483
Telemetry [candidate] (8.495 ms) : 0, 8495
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.479 ms) : 0, 3479
section profiling
crashtracking [baseline] (1.229 ms) : 0, 1229
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (707.661 ms) : 0, 707661
BytebuddyAgent [candidate] (709.234 ms) : 0, 709234
GlobalTracer [baseline] (226.798 ms) : 0, 226798
GlobalTracer [candidate] (227.299 ms) : 0, 227299
AppSec [baseline] (32.795 ms) : 0, 32795
AppSec [candidate] (32.72 ms) : 0, 32720
Debugger [baseline] (68.683 ms) : 0, 68683
Debugger [candidate] (68.137 ms) : 0, 68137
Remote Config [baseline] (629.097 µs) : 0, 629
Remote Config [candidate] (633.347 µs) : 0, 633
Telemetry [baseline] (9.013 ms) : 0, 9013
Telemetry [candidate] (8.924 ms) : 0, 8924
Flare Poller [baseline] (3.775 ms) : 0, 3775
Flare Poller [candidate] (3.643 ms) : 0, 3643
ProfilingAgent [baseline] (98.844 ms) : 0, 98844
ProfilingAgent [candidate] (97.477 ms) : 0, 97477
Profiling [baseline] (99.441 ms) : 0, 99441
Profiling [candidate] (98.081 ms) : 0, 98081
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769195899 1769195899
ci_job_id 1374027657 1374027657
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-rv8l54ad 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-rv8l54ad 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+1.035ms; +1.825ms] or [+5.796%; +10.221%]
worse
[+0.988ms; +2.527ms] or [+3.377%; +8.640%]
unstable
[-41.028op/s; +7.153op/s] or [-16.087%; +2.805%]
19.284ms 31.000ms 238.094op/s 17.854ms 29.243ms 255.031op/s
scenario:load:petclinic:no_agent:high_load better
[-2.407ms; -0.933ms] or [-12.605%; -4.889%]
unsure
[-3.302ms; -0.196ms] or [-10.507%; -0.624%]
unstable
[-5.226op/s; +47.601op/s] or [-2.187%; +19.922%]
17.424ms 29.679ms 260.125op/s 19.094ms 31.428ms 238.938op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.263 ms) : 3221, 3305
.   : milestone, 3263,
iast_FULL (5.695 ms) : 5639, 5751
.   : milestone, 5695,
iast_GLOBAL (3.554 ms) : 3493, 3615
.   : milestone, 3554,
profiling (2.079 ms) : 2060, 2098
.   : milestone, 2079,
tracing (1.817 ms) : 1801, 1832
.   : milestone, 1817,
section candidate
no_agent (1.181 ms) : 1169, 1193
.   : milestone, 1181,
iast (3.295 ms) : 3247, 3343
.   : milestone, 3295,
iast_FULL (5.906 ms) : 5845, 5967
.   : milestone, 5906,
iast_GLOBAL (3.68 ms) : 3613, 3746
.   : milestone, 3680,
profiling (1.988 ms) : 1971, 2006
.   : milestone, 1988,
tracing (1.874 ms) : 1857, 1890
.   : milestone, 1874,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.188 ms [1.176 ms, 1.2 ms] -
iast 3.263 ms [3.221 ms, 3.305 ms] 2.075 ms (174.7%)
iast_FULL 5.695 ms [5.639 ms, 5.751 ms] 4.507 ms (379.4%)
iast_GLOBAL 3.554 ms [3.493 ms, 3.615 ms] 2.366 ms (199.2%)
profiling 2.079 ms [2.06 ms, 2.098 ms] 890.935 µs (75.0%)
tracing 1.817 ms [1.801 ms, 1.832 ms] 628.516 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.193 ms] -
iast 3.295 ms [3.247 ms, 3.343 ms] 2.114 ms (179.0%)
iast_FULL 5.906 ms [5.845 ms, 5.967 ms] 4.725 ms (400.1%)
iast_GLOBAL 3.68 ms [3.613 ms, 3.746 ms] 2.499 ms (211.6%)
profiling 1.988 ms [1.971 ms, 2.006 ms] 807.408 µs (68.4%)
tracing 1.874 ms [1.857 ms, 1.89 ms] 692.621 µs (58.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.536 ms) : 19335, 19737
.   : milestone, 19536,
appsec (18.553 ms) : 18366, 18740
.   : milestone, 18553,
code_origins (17.588 ms) : 17414, 17763
.   : milestone, 17588,
iast (17.506 ms) : 17332, 17680
.   : milestone, 17506,
profiling (18.298 ms) : 18117, 18480
.   : milestone, 18298,
tracing (17.898 ms) : 17720, 18075
.   : milestone, 17898,
section candidate
no_agent (17.938 ms) : 17754, 18121
.   : milestone, 17938,
appsec (18.437 ms) : 18250, 18624
.   : milestone, 18437,
code_origins (17.857 ms) : 17678, 18036
.   : milestone, 17857,
iast (17.509 ms) : 17336, 17682
.   : milestone, 17509,
profiling (19.609 ms) : 19412, 19805
.   : milestone, 19609,
tracing (17.609 ms) : 17432, 17787
.   : milestone, 17609,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.536 ms [19.335 ms, 19.737 ms] -
appsec 18.553 ms [18.366 ms, 18.74 ms] -983.438 µs (-5.0%)
code_origins 17.588 ms [17.414 ms, 17.763 ms] -1.948 ms (-10.0%)
iast 17.506 ms [17.332 ms, 17.68 ms] -2.03 ms (-10.4%)
profiling 18.298 ms [18.117 ms, 18.48 ms] -1.238 ms (-6.3%)
tracing 17.898 ms [17.72 ms, 18.075 ms] -1.638 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.938 ms [17.754 ms, 18.121 ms] -
appsec 18.437 ms [18.25 ms, 18.624 ms] 499.127 µs (2.8%)
code_origins 17.857 ms [17.678 ms, 18.036 ms] -80.527 µs (-0.4%)
iast 17.509 ms [17.336 ms, 17.682 ms] -428.76 µs (-2.4%)
profiling 19.609 ms [19.412 ms, 19.805 ms] 1.671 ms (9.3%)
tracing 17.609 ms [17.432 ms, 17.787 ms] -328.619 µs (-1.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master leo.romanovsky/bump-openfeature-1.20.1
git_commit_date 1769179884 1769193544
git_commit_sha c6c245f 9acbd3c
release_version 1.59.0-SNAPSHOT~c6c245fe4a 1.59.0-SNAPSHOT~9acbd3cd38
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769195621 1769195621
ci_job_id 1374027658 1374027658
ci_pipeline_id 92558272 92558272
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-zez6zil6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-zez6zil6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.64 s) : 15640000, 15640000
.   : milestone, 15640000,
appsec (14.479 s) : 14479000, 14479000
.   : milestone, 14479000,
iast (17.819 s) : 17819000, 17819000
.   : milestone, 17819000,
iast_GLOBAL (17.792 s) : 17792000, 17792000
.   : milestone, 17792000,
profiling (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
tracing (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
section candidate
no_agent (15.603 s) : 15603000, 15603000
.   : milestone, 15603000,
appsec (14.553 s) : 14553000, 14553000
.   : milestone, 14553000,
iast (17.757 s) : 17757000, 17757000
.   : milestone, 17757000,
iast_GLOBAL (17.856 s) : 17856000, 17856000
.   : milestone, 17856000,
profiling (15.187 s) : 15187000, 15187000
.   : milestone, 15187000,
tracing (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.64 s [15.64 s, 15.64 s] -
appsec 14.479 s [14.479 s, 14.479 s] -1.161 s (-7.4%)
iast 17.819 s [17.819 s, 17.819 s] 2.179 s (13.9%)
iast_GLOBAL 17.792 s [17.792 s, 17.792 s] 2.152 s (13.8%)
profiling 15.163 s [15.163 s, 15.163 s] -477.0 ms (-3.0%)
tracing 15.02 s [15.02 s, 15.02 s] -620.0 ms (-4.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.603 s [15.603 s, 15.603 s] -
appsec 14.553 s [14.553 s, 14.553 s] -1.05 s (-6.7%)
iast 17.757 s [17.757 s, 17.757 s] 2.154 s (13.8%)
iast_GLOBAL 17.856 s [17.856 s, 17.856 s] 2.253 s (14.4%)
profiling 15.187 s [15.187 s, 15.187 s] -416.0 ms (-2.7%)
tracing 14.895 s [14.895 s, 14.895 s] -708.0 ms (-4.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~9acbd3cd38, baseline=1.59.0-SNAPSHOT~c6c245fe4a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.624 ms) : 3409, 3839
.   : milestone, 3624,
iast (2.212 ms) : 2147, 2278
.   : milestone, 2212,
iast_GLOBAL (2.241 ms) : 2176, 2305
.   : milestone, 2241,
profiling (2.063 ms) : 2010, 2116
.   : milestone, 2063,
tracing (2.041 ms) : 1990, 2092
.   : milestone, 2041,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.699 ms) : 3479, 3919
.   : milestone, 3699,
iast (2.213 ms) : 2148, 2278
.   : milestone, 2213,
iast_GLOBAL (2.25 ms) : 2184, 2315
.   : milestone, 2250,
profiling (2.081 ms) : 2027, 2135
.   : milestone, 2081,
tracing (2.042 ms) : 1991, 2094
.   : milestone, 2042,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 3.624 ms [3.409 ms, 3.839 ms] 2.156 ms (146.9%)
iast 2.212 ms [2.147 ms, 2.278 ms] 744.93 µs (50.8%)
iast_GLOBAL 2.241 ms [2.176 ms, 2.305 ms] 773.043 µs (52.7%)
profiling 2.063 ms [2.01 ms, 2.116 ms] 595.889 µs (40.6%)
tracing 2.041 ms [1.99 ms, 2.092 ms] 573.406 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.699 ms [3.479 ms, 3.919 ms] 2.227 ms (151.3%)
iast 2.213 ms [2.148 ms, 2.278 ms] 741.092 µs (50.4%)
iast_GLOBAL 2.25 ms [2.184 ms, 2.315 ms] 778.054 µs (52.9%)
profiling 2.081 ms [2.027 ms, 2.135 ms] 609.062 µs (41.4%)
tracing 2.042 ms [1.991 ms, 2.094 ms] 570.42 µs (38.8%)

@aarsilv aarsilv assigned leoromanovsky and unassigned aarsilv and sameerank Jan 23, 2026
@leoromanovsky leoromanovsky merged commit a89f803 into master Jan 23, 2026
580 checks passed
@leoromanovsky leoromanovsky deleted the leo.romanovsky/bump-openfeature-1.20.1 branch January 23, 2026 19:58
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: openfeature OpenFeature type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants