Skip to content

Fail integration tests on logged warnings - #2

Open
timcassell wants to merge 1 commit into
LoopedBard3:loopedbard3-r2r-reference-gatheringfrom
dotnet:loopedbard3-r2r-reference-gathering
Open

timcassell wants to merge 1 commit into
LoopedBard3:loopedbard3-r2r-reference-gatheringfrom
dotnet:loopedbard3-r2r-reference-gathering

Conversation

@timcassell

@timcassell timcassell commented Nov 6, 2026 •

Copy link
Copy Markdown

Builds on dotnet#3312's switch to full integration builds for publishing toolchains.

  • Fail integration tests on logged warnings. A failed reference-gathering pass only logs a warning and the benchmark still builds and runs, so a broken pass went unnoticed. CanExecute's full validation now fails on any logged warning, excluding the analyser conclusions (machine-dependent). Tests that expect warnings opt out with allowWarnings. The NativeAOT tests do, for BenchmarkDotNet's own IL2104/IL3053 trim and AOT warnings.
  • Disable static web assets in the gathering pass. That check caught a Wasm failure: the static web assets pipeline converts and fingerprints the program's assembly, which the gathering pass never compiles. The pass only resolves references, so it sets StaticWebAssetsEnabled=false.
  • Remove the dedicated R2R gathering test. With publishing toolchains going through gathering, the other integration tests (R2R, Wasm, NativeAOT, Mono, CoreRun) cover it.

🤖 Generated with Claude Code

A failed reference-gathering pass is only a warning, and the benchmark
still builds and runs, so CanExecute's full validation now fails on any
logged warning. Analyser conclusions are excluded since they depend on the
machine. Tests that expect warnings opt out with allowWarnings, as the
NativeAOT tests do for BenchmarkDotNet's own trim and AOT warnings.

With publishing toolchains going through reference gathering, that check
catches a Wasm failure: the static web assets pipeline converts the
program's assembly, which the gathering pass never compiles. The pass only
resolves references, so it disables static web assets.

The other integration tests now cover gathering for publishing toolchains,
which makes the dedicated R2R gathering test redundant.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant