Skip to content

test: harden bounded Kafka supervisor timeouts - #20124

Open
FrankChen021 wants to merge 5 commits into
apache:masterfrom
FrankChen021:codex/harden-kafka-bounded-supervisor-test-v2
Open

test: harden bounded Kafka supervisor timeouts#20124
FrankChen021 wants to merge 5 commits into
apache:masterfrom
FrankChen021:codex/harden-kafka-bounded-supervisor-test-v2

Conversation

@FrankChen021

Copy link
Copy Markdown
Member

Description

KafkaBoundedSupervisorTest can exceed the embedded cluster's default 60-second latch timeout while a bounded supervisor starts tasks, consumes records, and publishes segments.

The post-merge CI run for PR #20106 provides the evidence:

  • The Unit & Integration tests CI run 32516481844 failed in job 96879148560.
  • The failed JDK 25 shard timed out in KafkaBoundedSupervisorTest.test_boundedSupervisor_doesNotSilentlyCompleteWhenStaleOffsetExceedsNewEnd while waiting for 250 published records.
  • The same shard passed before merge in PR fix(server): master branch CI failure #20106.
  • PR #19543 previously addressed the same cold-start timing issue by using a 120-second wait for one bounded-supervisor ingestion path.

This change:

  • Applies a 120-second maximum wait to the bounded-supervisor ingestion waits. The timeout is a ceiling, not a fixed delay.
  • Uses maxRowsPerSegment = 100 for this test class instead of the shared fixture's one-row segments. This reduces segment rollover and publication overhead while preserving the test's offset, row-count, and supervisor-state assertions.

There is no user-facing behavior change.

Release note

No user-facing behavior change.


Key changed/added classes in this PR
  • KafkaBoundedSupervisorTest

This PR has:

  • been self-reviewed.
  • modified an existing test to cover the affected CI timing path.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description (test-only change).
  • added or updated version, license, or notice information in licenses.yaml.

Local verification:

mvn test -pl embedded-tests -am -Dtest=org.apache.druid.testing.embedded.indexing.KafkaBoundedSupervisorTest -Dsurefire.failIfNoSpecifiedTests=false -Pskip-static-checks -Dweb.console.skip=true -T1

Result: 6 tests passed; Maven reactor BUILD SUCCESS.

Copilot AI lite review requested due to automatic review settings August 22, 2026 04:29

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants