Draft
Fix Daily Go Test Parallelizer failures: drop preview cloud-hypervisor runtime, restore daily schedule#54730
Conversation
…edule Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Fix low success rate and high-cost failures in daily Go Test Parallelizer
Fix Daily Go Test Parallelizer failures: drop preview cloud-hypervisor runtime, restore daily schedule
Aug 22, 2026
Contributor
PR Triage
|
Contributor
PR TriageCategory: Draft but high-value: fixes 42.86% CI success rate / ~$274/day cost issue on Daily Go Test Parallelizer. Should be undrafted to fast_track. Automated triage — run 32572524009
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The
Daily Go Test Parallelizerworkflow was reported at a 42.86% success rate costing ~$274/day for 3 safe items. Investigation shows both symptoms have causes different from those hypothesized in the issue.Failure root cause
Failures cluster contiguously (runs #63–#68, #53–#55), not randomly. Every failed run aborts in the
agentjob'sExecute GitHub Copilot CLIstep with the same signature (verified on runs 32447678169 and 32404370749):The guest VM's
eth0comes upNO-CARRIER/DOWNand the probe fails withfallback=disabled. This is preview-runtime infrastructure, not a flaky test shard or aggregation error. Failed runs die ~2 min into the agent job and never invoke the model — they consume no agent tokens, so the issue's premise that failures are expensive does not hold, and neither a fail-fast smoke step nor shard-scoped retry would help.Cost root cause
The schedule was
every 2h— 12 runs/day — while the workflow is named "Daily", described as "daily round-robin analysis", and its body references "the next daily run". Spend was driven by successful runs firing 12× more often than intended.Changes
sandbox.agent.runtime: cloud-hypervisorremoved — falls back to the default rootless Docker sandbox. Also reduces privilege surface; the repo linter independently flags this runtime as "a privileged KVM preview path… require a human security review".schedule: every 2h→schedule: daily— restores intended cadence, ~12× cost reduction. Round-robin advance is unaffected; each run still persistslast_fileto cache memory.daily-go-test-parallelizer.lock.yml.No retry logic or pre-flight smoke step was added; both were suggested in the issue but neither addresses the actual failure.
Follow-up
~40 other workflows still pin
cloud-hypervisorand are exposed to the same intermittent probe failure. Out of scope here, but likely worth its own tracking issue.