Repository navigation
Open
Labels
area:buildCI/CD workflows, releases, build targets, packaging, and artifact publication.CI/CD workflows, releases, build targets, packaging, and artifact publication.topic:testingUnit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.Unit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.
Description
User Story
As a contributor waiting on Branch E2E, I want the Linux VM driver build to finish sooner, so that the Debian package, the last input to the tmachine rows, stops trailing the RPM.
Description
After #5530, build-deb runs on a hosted runner and starts as soon as build-vm-driver-linux finishes. In run 44021924417, the deb finished 1.1 minutes after the RPM. That remaining gap is the VM driver build, which also delays every release build.
Where the VM driver job spends its time:
- It waits for every Linux binary. It only uses the
openshell-sandbox,openshell-supervisorandopenshell-vm-initartifacts, butneeds: build-binaries-linuxalso waits for the slower gateway legs. In the baseline runs, the gateway finished 1–2 minutes after the supervisor. - It queues on the self-hosted pool. It runs on
linux-amd64-cpu8/linux-arm64-cpu8. In run 43257220972 it waited 3.6 minutes for a runner, and the deb finished 7.1 minutes after the RPM. - Most of the job is compiling the driver. In run 44021924417,
setup-nixtook ~50 s, compressing the embedded binaries ~30 s, andBuild openshell-driver-vm~160 s. Only the final embedding step needs the downloaded binaries.
Options to evaluate:
- Depend only on the three binaries the driver embeds, for example by splitting them out of
build-binaries-linuxor giving them their own reusable workflow call. - Start the job alongside
build-binaries-linux: set up Nix and compile the driver's dependencies first, then wait for the artifacts and embed them. - Move the job to a hosted runner, if the build fits its CPU and disk limits.
Context
- Parent: test: retire the old e2e test system onto testkit #5281
- Follow-up to ci(e2e): build the Debian package on a hosted runner #5530
.github/workflows/build-vm-driver-linux.yml,.github/workflows/build-binaries-linux.yml,.github/workflows/branch-e2e.yml- Callers that use the VM driver:
branch-e2e.yml,release-build.yml,release-dev.yml
Definition of Done
-
build-vm-driver-linuxno longer waits for builds it doesn't use, or no longer queues on the self-hosted pool. - Release builds still produce the same VM driver and Debian packages.
- Branch E2E passes, and the PR records before/after times for the VM driver and the deb.
Metadata
Metadata
Assignees
Labels
area:buildCI/CD workflows, releases, build targets, packaging, and artifact publication.CI/CD workflows, releases, build targets, packaging, and artifact publication.topic:testingUnit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.Unit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.
Activity