Allow openshift/conformance/serial tests 50 min to complete - #31627
Allow openshift/conformance/serial tests 50 min to complete#31627jacobsee wants to merge 1 commit into
Conversation
The bump from 40 to 50 min is because we have observed significant slowdowns in AWS loadbalancer/healthcheck behavior, causing kube-apiserver to take longer to wait for network loadbalancers to drain so that it can safely shut down. In observation, this means that a KAS rollout now takes ~20 minutes. A test that does a rollout and then reverts its change needs ~40 minutes just for rollouts.
|
Pipeline controller notification For optional jobs, comment This repository is configured in: automatic mode |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: jacobsee The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Repository YAML (base), Central YAML (inherited) Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
Included review availability: Your plan provides up to 12 included reviews per hour; 11 remain after this review. WalkthroughThe ChangesConformance timeout
Priority: ⬇️ Low Estimated code review effort: 1 (Trivial) | ~2 minutes Merge Risk: ⚪ Minimal · up to The serial conformance suite receives an additional ten minutes to accommodate slower rollout scenarios, reducing avoidable timeout failures without changing test behavior. No current merge-readiness risk remains. Suggested reviewers: 🚥 Pre-merge checks | ✅ 15✅ Passed checks (15 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
Scheduling tests matching the |
|
/override-sticky ci/prow/e2e-aws-ovn-serial-2of2 Automated triage: This failure appears unrelated to the PR changes. Job classification: Eligible long-running presubmit e2e/integration job. The generated job uses the Revision check: Run Execution status: Tests executed. The log shows Completed supporting jobs: Overlap assessment: The PR changes one line in Missing-coverage risk: Low. The changed conformance serial surface executed and passed, the monitor suite executed and isolated the failure to cluster health, and multiple other e2e presubmits passed. This override removes an infrastructure-derived blocking result; it does not substitute for unexecuted coverage. Rationale: The failed invariant observed sustained etcd communication degradation, including the alert firing across etcd members and corroborating API/etcd instability. Historical CI analysis shows this job passed 18 of its last 20 runs, with another occurrence on PR #31593. No overlapping SHIP outage record was found for the run window. If you disagree with this assessment, rerun the current job with AI-generated. Review for accuracy. |
|
@redhat-chai-bot: Overrode contexts on behalf of redhat-chai-bot: ci/prow/e2e-aws-ovn-serial-2of2 These overrides will persist across retests on the current HEAD SHA. Pushing a new commit will clear them. Use DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
@jacobsee: all tests passed! Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
The bump from 40 to 50 min is because we have observed significant slowdowns in AWS loadbalancer/healthcheck behavior, causing kube-apiserver to take longer to wait for network loadbalancers to drain so that it can safely shut down. In observation, this means that a KAS rollout now takes ~20 minutes. A test that does a rollout and then reverts its change needs ~40 minutes just for rollouts.
Summary by CodeRabbit