Push system-tests results to test optimization #10422

nccatoni · 2026-01-22T13:58:26Z

What Does This Do

Pushing results from system-tests to test optimization.

Motivation

Required for tracking the evolution of flaky tests and gives better insight into test results in general.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2026-01-22T14:48:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nccatoni/system-tests-test-optim
git_commit_date	1769086485	1769090259
git_commit_sha	`3d62379`	`966dd1c`
release_version	1.59.0-SNAPSHOT~3d62379c90	1.59.0-SNAPSHOT~966dd1cfbc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1769092141	1769092141
ci_job_id	1369871978	1369871978
ci_pipeline_id	92263007	92263007
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-xfp40b9x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-xfp40b9x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1088326
Total [baseline] (8.743 s) : 0, 8743320
Agent [candidate] (1.085 s) : 0, 1085325
Total [candidate] (8.773 s) : 0, 8772950
section iast
Agent [baseline] (1.233 s) : 0, 1232509
Total [baseline] (9.377 s) : 0, 9377473
Agent [candidate] (1.222 s) : 0, 1222262
Total [candidate] (9.348 s) : 0, 9347829

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.088 s	-
Agent	iast	1.233 s	144.182 ms (13.2%)
Total	tracing	8.743 s	-
Total	iast	9.377 s	634.152 ms (7.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.085 s	-
Agent	iast	1.222 s	136.937 ms (12.6%)
Total	tracing	8.773 s	-
Total	iast	9.348 s	574.879 ms (6.6%)

gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (653.021 ms) : 0, 653021
BytebuddyAgent [candidate] (651.957 ms) : 0, 651957
GlobalTracer [baseline] (285.196 ms) : 0, 285196
GlobalTracer [candidate] (283.728 ms) : 0, 283728
AppSec [baseline] (32.784 ms) : 0, 32784
AppSec [candidate] (32.452 ms) : 0, 32452
Debugger [baseline] (67.506 ms) : 0, 67506
Debugger [candidate] (66.386 ms) : 0, 66386
Remote Config [baseline] (617.06 µs) : 0, 617
Remote Config [candidate] (635.582 µs) : 0, 636
Telemetry [baseline] (8.773 ms) : 0, 8773
Telemetry [candidate] (8.885 ms) : 0, 8885
Flare Poller [baseline] (3.803 ms) : 0, 3803
Flare Poller [candidate] (4.575 ms) : 0, 4575
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (798.469 ms) : 0, 798469
BytebuddyAgent [candidate] (790.673 ms) : 0, 790673
GlobalTracer [baseline] (258.286 ms) : 0, 258286
GlobalTracer [candidate] (256.324 ms) : 0, 256324
AppSec [baseline] (33.475 ms) : 0, 33475
AppSec [candidate] (33.349 ms) : 0, 33349
Debugger [baseline] (65.838 ms) : 0, 65838
Debugger [candidate] (65.959 ms) : 0, 65959
Remote Config [baseline] (583.965 µs) : 0, 584
Remote Config [candidate] (575.13 µs) : 0, 575
Telemetry [baseline] (8.462 ms) : 0, 8462
Telemetry [candidate] (8.357 ms) : 0, 8357
Flare Poller [baseline] (3.619 ms) : 0, 3619
Flare Poller [candidate] (3.55 ms) : 0, 3550
IAST [baseline] (27.164 ms) : 0, 27164
IAST [candidate] (27.008 ms) : 0, 27008

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090972
Total [baseline] (10.848 s) : 0, 10848304
Agent [candidate] (1.087 s) : 0, 1087405
Total [candidate] (10.836 s) : 0, 10835651
section appsec
Agent [baseline] (1.267 s) : 0, 1266969
Total [baseline] (11.024 s) : 0, 11023967
Agent [candidate] (1.275 s) : 0, 1274613
Total [candidate] (11.129 s) : 0, 11128872
section iast
Agent [baseline] (1.228 s) : 0, 1228183
Total [baseline] (11.292 s) : 0, 11291976
Agent [candidate] (1.225 s) : 0, 1225170
Total [candidate] (11.204 s) : 0, 11203638
section profiling
Agent [baseline] (1.202 s) : 0, 1201710
Total [baseline] (10.867 s) : 0, 10866986
Agent [candidate] (1.208 s) : 0, 1208472
Total [candidate] (10.858 s) : 0, 10857596

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	appsec	1.267 s	175.997 ms (16.1%)
Agent	iast	1.228 s	137.211 ms (12.6%)
Agent	profiling	1.202 s	110.739 ms (10.2%)
Total	tracing	10.848 s	-
Total	appsec	11.024 s	175.663 ms (1.6%)
Total	iast	11.292 s	443.672 ms (4.1%)
Total	profiling	10.867 s	18.681 ms (0.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.087 s	-
Agent	appsec	1.275 s	187.208 ms (17.2%)
Agent	iast	1.225 s	137.766 ms (12.7%)
Agent	profiling	1.208 s	121.067 ms (11.1%)
Total	tracing	10.836 s	-
Total	appsec	11.129 s	293.222 ms (2.7%)
Total	iast	11.204 s	367.987 ms (3.4%)
Total	profiling	10.858 s	21.946 ms (0.2%)

gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (654.356 ms) : 0, 654356
BytebuddyAgent [candidate] (652.908 ms) : 0, 652908
GlobalTracer [baseline] (285.009 ms) : 0, 285009
GlobalTracer [candidate] (283.969 ms) : 0, 283969
AppSec [baseline] (32.965 ms) : 0, 32965
AppSec [candidate] (32.476 ms) : 0, 32476
Debugger [baseline] (66.955 ms) : 0, 66955
Debugger [candidate] (66.456 ms) : 0, 66456
Remote Config [baseline] (617.877 µs) : 0, 618
Remote Config [candidate] (632.614 µs) : 0, 633
Telemetry [baseline] (8.973 ms) : 0, 8973
Telemetry [candidate] (8.869 ms) : 0, 8869
Flare Poller [baseline] (5.451 ms) : 0, 5451
Flare Poller [candidate] (5.374 ms) : 0, 5374
section appsec
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (691.834 ms) : 0, 691834
BytebuddyAgent [candidate] (696.366 ms) : 0, 696366
GlobalTracer [baseline] (259.494 ms) : 0, 259494
GlobalTracer [candidate] (261.502 ms) : 0, 261502
IAST [baseline] (24.519 ms) : 0, 24519
IAST [candidate] (24.911 ms) : 0, 24911
AppSec [baseline] (173.891 ms) : 0, 173891
AppSec [candidate] (173.336 ms) : 0, 173336
Debugger [baseline] (66.588 ms) : 0, 66588
Debugger [candidate] (67.744 ms) : 0, 67744
Remote Config [baseline] (780.677 µs) : 0, 781
Remote Config [candidate] (815.189 µs) : 0, 815
Telemetry [baseline] (9.433 ms) : 0, 9433
Telemetry [candidate] (9.412 ms) : 0, 9412
Flare Poller [baseline] (3.79 ms) : 0, 3790
Flare Poller [candidate] (3.767 ms) : 0, 3767
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (794.569 ms) : 0, 794569
BytebuddyAgent [candidate] (792.565 ms) : 0, 792565
GlobalTracer [baseline] (257.219 ms) : 0, 257219
GlobalTracer [candidate] (257.058 ms) : 0, 257058
IAST [baseline] (27.042 ms) : 0, 27042
IAST [candidate] (26.864 ms) : 0, 26864
AppSec [baseline] (34.247 ms) : 0, 34247
AppSec [candidate] (34.11 ms) : 0, 34110
Debugger [baseline] (66.048 ms) : 0, 66048
Debugger [candidate] (65.683 ms) : 0, 65683
Remote Config [baseline] (548.658 µs) : 0, 549
Remote Config [candidate] (568.291 µs) : 0, 568
Telemetry [baseline] (8.458 ms) : 0, 8458
Telemetry [candidate] (8.373 ms) : 0, 8373
Flare Poller [baseline] (3.545 ms) : 0, 3545
Flare Poller [candidate] (3.542 ms) : 0, 3542
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (700.403 ms) : 0, 700403
BytebuddyAgent [candidate] (704.952 ms) : 0, 704952
GlobalTracer [baseline] (221.114 ms) : 0, 221114
GlobalTracer [candidate] (222.122 ms) : 0, 222122
AppSec [baseline] (32.186 ms) : 0, 32186
AppSec [candidate] (32.367 ms) : 0, 32367
Debugger [baseline] (67.457 ms) : 0, 67457
Debugger [candidate] (67.875 ms) : 0, 67875
Remote Config [baseline] (663.843 µs) : 0, 664
Remote Config [candidate] (675.798 µs) : 0, 676
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (8.846 ms) : 0, 8846
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.727 ms) : 0, 3727
ProfilingAgent [baseline] (96.3 ms) : 0, 96300
ProfilingAgent [candidate] (96.744 ms) : 0, 96744
Profiling [baseline] (96.866 ms) : 0, 96866
Profiling [candidate] (97.327 ms) : 0, 97327

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nccatoni/system-tests-test-optim
git_commit_date	1769086485	1769090259
git_commit_sha	`3d62379`	`966dd1c`
release_version	1.59.0-SNAPSHOT~3d62379c90	1.59.0-SNAPSHOT~966dd1cfbc

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1769092731	1769092731
ci_job_id	1369871979	1369871979
ci_pipeline_id	92263007	92263007
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-4k56f0z0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-4k56f0z0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-255.490µs; -131.185µs] or [-9.096%; -4.671%]	better [-663.038µs; -235.930µs] or [-8.385%; -2.983%]	unstable [-76.534op/s; +209.284op/s] or [-5.931%; +16.219%]	2.615ms	7.458ms	1356.750op/s	2.809ms	7.908ms	1290.375op/s
scenario:load:petclinic:appsec:high_load	worse [+0.905ms; +1.738ms] or [+4.991%; +9.583%]	worse [+0.955ms; +2.217ms] or [+3.242%; +7.527%]	unstable [-38.738op/s; +8.051op/s] or [-15.357%; +3.192%]	19.454ms	31.040ms	236.906op/s	18.133ms	29.455ms	252.250op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.151 ms) : 17967, 18335
.   : milestone, 18151,
appsec (18.498 ms) : 18313, 18684
.   : milestone, 18498,
code_origins (17.997 ms) : 17818, 18175
.   : milestone, 17997,
iast (18.099 ms) : 17919, 18279
.   : milestone, 18099,
profiling (18.851 ms) : 18659, 19043
.   : milestone, 18851,
tracing (17.499 ms) : 17326, 17672
.   : milestone, 17499,
section candidate
no_agent (17.14 ms) : 16969, 17312
.   : milestone, 17140,
appsec (19.703 ms) : 19504, 19903
.   : milestone, 19703,
code_origins (17.945 ms) : 17764, 18126
.   : milestone, 17945,
iast (17.724 ms) : 17549, 17899
.   : milestone, 17724,
profiling (18.837 ms) : 18647, 19027
.   : milestone, 18837,
tracing (17.495 ms) : 17323, 17667
.   : milestone, 17495,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.151 ms [17.967 ms, 18.335 ms]	-
appsec	18.498 ms [18.313 ms, 18.684 ms]	347.443 µs (1.9%)
code_origins	17.997 ms [17.818 ms, 18.175 ms]	-154.396 µs (-0.9%)
iast	18.099 ms [17.919 ms, 18.279 ms]	-52.439 µs (-0.3%)
profiling	18.851 ms [18.659 ms, 19.043 ms]	700.101 µs (3.9%)
tracing	17.499 ms [17.326 ms, 17.672 ms]	-652.136 µs (-3.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.14 ms [16.969 ms, 17.312 ms]	-
appsec	19.703 ms [19.504 ms, 19.903 ms]	2.563 ms (15.0%)
code_origins	17.945 ms [17.764 ms, 18.126 ms]	804.563 µs (4.7%)
iast	17.724 ms [17.549 ms, 17.899 ms]	583.953 µs (3.4%)
profiling	18.837 ms [18.647 ms, 19.027 ms]	1.697 ms (9.9%)
tracing	17.495 ms [17.323 ms, 17.667 ms]	354.415 µs (2.1%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.167 ms) : 1157, 1178
.   : milestone, 1167,
iast (3.27 ms) : 3227, 3314
.   : milestone, 3270,
iast_FULL (5.88 ms) : 5820, 5940
.   : milestone, 5880,
iast_GLOBAL (3.552 ms) : 3501, 3602
.   : milestone, 3552,
profiling (1.97 ms) : 1951, 1989
.   : milestone, 1970,
tracing (1.862 ms) : 1845, 1879
.   : milestone, 1862,
section candidate
no_agent (1.192 ms) : 1180, 1203
.   : milestone, 1192,
iast (3.238 ms) : 3194, 3283
.   : milestone, 3238,
iast_FULL (5.741 ms) : 5683, 5799
.   : milestone, 5741,
iast_GLOBAL (3.375 ms) : 3323, 3428
.   : milestone, 3375,
profiling (1.967 ms) : 1949, 1984
.   : milestone, 1967,
tracing (1.788 ms) : 1773, 1803
.   : milestone, 1788,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.167 ms [1.157 ms, 1.178 ms]	-
iast	3.27 ms [3.227 ms, 3.314 ms]	2.103 ms (180.1%)
iast_FULL	5.88 ms [5.82 ms, 5.94 ms]	4.712 ms (403.7%)
iast_GLOBAL	3.552 ms [3.501 ms, 3.602 ms]	2.384 ms (204.2%)
profiling	1.97 ms [1.951 ms, 1.989 ms]	802.627 µs (68.8%)
tracing	1.862 ms [1.845 ms, 1.879 ms]	694.835 µs (59.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.192 ms [1.18 ms, 1.203 ms]	-
iast	3.238 ms [3.194 ms, 3.283 ms]	2.047 ms (171.7%)
iast_FULL	5.741 ms [5.683 ms, 5.799 ms]	4.549 ms (381.7%)
iast_GLOBAL	3.375 ms [3.323 ms, 3.428 ms]	2.183 ms (183.2%)
profiling	1.967 ms [1.949 ms, 1.984 ms]	775.133 µs (65.0%)
tracing	1.788 ms [1.773 ms, 1.803 ms]	596.502 µs (50.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nccatoni/system-tests-test-optim
git_commit_date	1769086485	1769090259
git_commit_sha	`3d62379`	`966dd1c`
release_version	1.59.0-SNAPSHOT~3d62379c90	1.59.0-SNAPSHOT~966dd1cfbc

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1769092597	1769092597
ci_job_id	1369871980	1369871980
ci_pipeline_id	92263007	92263007
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-5iz9zwk5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-5iz9zwk5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1491
.   : milestone, 1479,
appsec (3.73 ms) : 3512, 3949
.   : milestone, 3730,
iast (2.216 ms) : 2151, 2281
.   : milestone, 2216,
iast_GLOBAL (2.26 ms) : 2195, 2325
.   : milestone, 2260,
profiling (2.065 ms) : 2012, 2118
.   : milestone, 2065,
tracing (2.062 ms) : 2011, 2113
.   : milestone, 2062,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.682 ms) : 3467, 3898
.   : milestone, 3682,
iast (2.216 ms) : 2151, 2280
.   : milestone, 2216,
iast_GLOBAL (2.25 ms) : 2185, 2315
.   : milestone, 2250,
profiling (2.065 ms) : 2013, 2118
.   : milestone, 2065,
tracing (2.053 ms) : 2002, 2104
.   : milestone, 2053,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.491 ms]	-
appsec	3.73 ms [3.512 ms, 3.949 ms]	2.251 ms (152.2%)
iast	2.216 ms [2.151 ms, 2.281 ms]	737.239 µs (49.8%)
iast_GLOBAL	2.26 ms [2.195 ms, 2.325 ms]	780.719 µs (52.8%)
profiling	2.065 ms [2.012 ms, 2.118 ms]	585.851 µs (39.6%)
tracing	2.062 ms [2.011 ms, 2.113 ms]	582.767 µs (39.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.464 ms, 1.487 ms]	-
appsec	3.682 ms [3.467 ms, 3.898 ms]	2.207 ms (149.6%)
iast	2.216 ms [2.151 ms, 2.28 ms]	740.561 µs (50.2%)
iast_GLOBAL	2.25 ms [2.185 ms, 2.315 ms]	774.908 µs (52.5%)
profiling	2.065 ms [2.013 ms, 2.118 ms]	590.015 µs (40.0%)
tracing	2.053 ms [2.002 ms, 2.104 ms]	577.734 µs (39.2%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~966dd1cfbc, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.508 s) : 15508000, 15508000
.   : milestone, 15508000,
appsec (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
iast (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
iast_GLOBAL (17.766 s) : 17766000, 17766000
.   : milestone, 17766000,
profiling (15.295 s) : 15295000, 15295000
.   : milestone, 15295000,
tracing (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
section candidate
no_agent (15.542 s) : 15542000, 15542000
.   : milestone, 15542000,
appsec (14.543 s) : 14543000, 14543000
.   : milestone, 14543000,
iast (18.875 s) : 18875000, 18875000
.   : milestone, 18875000,
iast_GLOBAL (17.67 s) : 17670000, 17670000
.   : milestone, 17670000,
profiling (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,
tracing (14.669 s) : 14669000, 14669000
.   : milestone, 14669000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.508 s [15.508 s, 15.508 s]	-
appsec	15.027 s [15.027 s, 15.027 s]	-481.0 ms (-3.1%)
iast	18.258 s [18.258 s, 18.258 s]	2.75 s (17.7%)
iast_GLOBAL	17.766 s [17.766 s, 17.766 s]	2.258 s (14.6%)
profiling	15.295 s [15.295 s, 15.295 s]	-213.0 ms (-1.4%)
tracing	14.979 s [14.979 s, 14.979 s]	-529.0 ms (-3.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.542 s [15.542 s, 15.542 s]	-
appsec	14.543 s [14.543 s, 14.543 s]	-999.0 ms (-6.4%)
iast	18.875 s [18.875 s, 18.875 s]	3.333 s (21.4%)
iast_GLOBAL	17.67 s [17.67 s, 17.67 s]	2.128 s (13.7%)
profiling	14.765 s [14.765 s, 14.765 s]	-777.0 ms (-5.0%)
tracing	14.669 s [14.669 s, 14.669 s]	-873.0 ms (-5.6%)

Push system-tests results to test optimization

966dd1c

nccatoni added the tag: no release notes Changes to exclude from release notes label Jan 22, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Push system-tests results to test optimization #10422

Push system-tests results to test optimization #10422

Uh oh!

nccatoni commented Jan 22, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Jan 22, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Push system-tests results to test optimization #10422

Are you sure you want to change the base?

Push system-tests results to test optimization #10422

Uh oh!

Conversation

nccatoni commented Jan 22, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jan 22, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

nccatoni commented Jan 22, 2026 •

edited

Loading