Skip to content

test(net): quarantine two load-sensitive js/net tests - #8287

Merged
kixelated merged 3 commits into
mainfrom
quest/js-net-flakes-quarantine
Nov 8, 2026
Merged

kixelated merged 3 commits into
mainfrom
quest/js-net-flakes-quarantine

Conversation

@kixelated

@kixelated kixelated commented Nov 8, 2026 •

Copy link
Copy Markdown
Collaborator

Skips two js/net tests that fail under load, per AGENTS.md's rule to disable flaky tests immediately, and plans each fix as a child of quest/m0/test-flakes-2:

  • bandwidth.test.ts: "a connection samples the transport only while a reservation reads the estimate" → bandwidth-sampling.md
  • datagram-tracks.test.ts: "lite-07 bounds and prioritizes independent createWritable datagram queues" → datagram-queues.md

quest check and just check pass locally.

(Written by Claude Opus 5.5 with low)

🤖 Generated with Claude Code

Review

Rewritten by quest review after each round.

  • Reviewer: Codex, gpt-6.1-sol, medium effort
  • Session: 01a1bc5c-b771-7e71-81dd-2db1645b71a8, round 2
  • Head: c5e80d0
  • Base: origin/main at aabd6d7
  • Score: 10/10, The incremental change quarantines only the flaky lite-06 case and documents a scoped investigation, with no actionable defects found; builds and tests were not run as instructed.
  • Findings: none

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 54 seconds.

Check out review usage here.

View limit details

Limit details: You’ve used all 4 included reviews currently available.

Learn how review limits work.

Review configuration:

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 6af16b31-7ce0-4e55-9837-6f21d89e5e28
Commits

Reviewing files that changed from the base of the PR and between ee0d4e1 and c5e80d0.

Files selected for processing: 6

  • js/net/src/connection/bandwidth.test.ts
  • js/net/src/lite/datagram-tracks.test.ts
  • quest/m0/test-flakes-2/README.md
  • quest/m0/test-flakes-2/bandwidth-sampling.md
  • quest/m0/test-flakes-2/datagram-queues.md
  • quest/m0/test-flakes-2/session-close-end.md
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@kixelated kixelated left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review by review (OpenAI)

Reviewed 463f7e6. No actionable findings.

The diff quarantines exactly the two named tests and adds linked, indexed follow-ups requiring cause-based synchronization and removal of the skips. Checked the existing test bodies against the plans: the bandwidth test counts three ticks in 350 ms of Manual time, and the datagram test checks queue creation/priority and oversized-payload sequencing. No runtime implementation changes are included.

Verification limits: static GitHub review only; no loaded-machine reproduction, tests, or quest checks run. The documented scheduling causes remain hypotheses for the follow-up investigations.

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ No critical issues — one minor documentation correction inline.

Reviewed changes

  • Quarantines both tests: test.skip replaces test in bandwidth.test.ts and datagram-tracks.test.ts, each with a comment pointing at the owning child quest.
  • Plans both fixes: two new [XS] children under quest/m0/test-flakes-2/, plus the epic README's 2026-11-08 note and two ## Required entries.
  • Verified: biome check passes on both test files, bun test on them reports 45 pass / 2 skip / 0 fail, and the Quest workflow passed on 463f7e6. No sh/gh/test-inventory.allow entry applies, since that file only covers opt-in Rust #[ignore] and script targets.

Pullfrog  | Fix all ➔ | Fix 👍s ➔ | View workflow run | Using deepseek-v4.1-flash-1017 (free via Pullfrog for OSS) | 𝕏

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ No critical issues — one minor documentation correction inline.

Reviewed changes

  • Corrected the datagram quest's provenance: datagram-queues.md now cites #7846 as the lite-07 test's origin (verified: merged 2026-11-05, touched the file) and cites a merge-queue drop as the failure evidence.
  • Merged origin/main: the branch now carries main's unrelated widened max-age re-drop note; no conflict resolution touched this PR's files.

Pullfrog  | Fix all ➔ | Fix 👍s ➔ | View workflow run | Using deepseek-v4.1-flash-1017 (free via Pullfrog for OSS) | 𝕏

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

@kixelated kixelated left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review by review (OpenAI)

Reviewed c5e80d0 incrementally from 463f7e6, accounting for the main merge. No new actionable findings.

The additional quarantine selects only lite-06 for the session-close-after-datagram-end test; lite-05 and lite-07 remain enabled. Its linked and indexed follow-up accurately identifies the existing 10,000-microtask drain and calls for investigating the end/close ordering rather than increasing the drain or retrying. The datagram-queue plan also corrects the failure attribution. No production behavior changes are included.

Verification limits: static GitHub review only; no tests, loaded-machine reproduction, or quest checks run. The reported failure's underlying cause remains unverified.

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ No new issues found.

Reviewed changes

Changes since the prior pullfrog review at d30271b:

  • Quarantined the lite-06 session-close case: datagram-tracks.test.ts:473-475 selects test.skip only for ALPN_06 via const run = alpn === ALPN_06 ? test.skip : test;, leaving the lite-05 and lite-07 cases enabled.
  • Added session-close-end.md: a [S] child quest citing the actual failing merge-queue job (128758087035), identifying the pending step (SUBSCRIBE_FINISH, FIN, or the datagram wait) before client.abort(), and requiring an awaited event rather than a longer drain.
  • Dropped the #8280 misattribution: datagram-queues.md no longer claims the lite-07 queue test dropped #8280; that evidence now lives in session-close-end.md.
  • Updated the epic README: the 2026-11-08 note names the lite-06 case, and ## Required indexes the new child.
  • Verified: bun test src/lite/datagram-tracks.test.ts reports 38 pass / 2 skip / 0 fail (lite-06 skipped, lite-05 and lite-07 pass, so the detached test.skip reference behaves), and bun run check in js/net (tsc for src, examples, bench) is clean. The quest's Session: remote error: 0 citation matches Session in js/net/src/error.ts:151 and closeError at error.ts:567.

Pullfrog  | View workflow run | Using deepseek-v4.1-flash-1017 (free via Pullfrog for OSS) | 𝕏

@kixelated
kixelated added this pull request to the merge queue Nov 8, 2026
Merged via the queue into main with commit 9f51fa0 Nov 8, 2026
7 checks passed
@kixelated
kixelated deleted the quest/js-net-flakes-quarantine branch November 8, 2026 19:09
kixelated added a commit that referenced this pull request Nov 8, 2026
The test was quarantined in #8287 as flaky under load. Its suspected cause is
an ordering assumption, not a timeout, and I could not reproduce a failure:
it passed every run on the un-skipped test (about 6,000, most under heavy CPU
load, including forced write-budget yields on every poll and five runs of the
whole js/net suite).

The quest stays open with the un-reproduced cause written down, and a Waiting
item asks the maintainer whether to keep the test un-skipped.

Co-Authored-By: Claude Haiku 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant