Getting `No results found during the execution` error with sharded and allow empty

[XSAM]

Hi, I am evaluating CodSpeed for https://github.com/open-telemetry/opentelemetry-go project. And, I am using the sharded benchmark feature with the allow-empty option because we have a lot of benchmarks to run (issue) and not every packages have benchmarks.

After successfully running the benchmark CI, I am getting No results found during the execution error from CodSpeed Performance Analysis. https://github.com/XSAM/opentelemetry-go/runs/61076792378

The benchmark result page is empty with failure.

Commit: XSAM/opentelemetry-go@b6799cc
Github action: https://github.com/XSAM/opentelemetry-go/actions/runs/21224800248
Performance result page: https://codspeed.io/XSAM/opentelemetry-go/runs/697138a2fc769cac9e9eb958

cc @not-matthias

[fargito]

Hello, and thanks for the report.

The allow-empty option is not currently on our public API, because it does not work with all our instruments. However, with the walltime instrument, it could work.

The issue should be fixed in the next release of CodSpeed.