Skip to content

Fix or disable the systematically broken e2e_tests_lightspeed_evaluation.yaml workflow #3080

Open

Description

@fullsend-ai-retro

What happened

The .github/workflows/e2e_tests_lightspeed_evaluation.yaml workflow has a 100% failure rate across all branches (verified against the last 10 runs: all failed with zero jobs dispatched). On PR #2995, run 40922448171 failed instantly (created and updated at the same second) with an empty jobs list, indicating the workflow YAML itself is invalid or misconfigured — GitHub Actions cannot parse it to create jobs. The same pattern repeats on main, agent/*, and feature branches alike.

What could go better

A workflow that fails 100% of the time on every branch is pure noise. It desensitizes reviewers to red CI signals and wastes compute (however briefly). Confidence is high: the evidence spans 10+ consecutive runs on multiple branches with no variation in outcome.

Proposed change

Diagnose the misconfiguration in .github/workflows/e2e_tests_lightspeed_evaluation.yaml (likely a YAML syntax error, missing required input, or invalid trigger condition that prevents job creation) and fix it. If the workflow is no longer needed, remove or disable it by commenting out its triggers. If the fix requires infrastructure that is not yet available, add an explicit if: false guard with a TODO comment referencing the blocker.

Validation criteria

The next 5 workflow runs of e2e_tests_lightspeed_evaluation.yaml either succeed or are cleanly skipped (not errored with zero jobs). No runs fail with an empty jobs list.

Related issues checked

Searched: e2e evaluation workflow broken failing; e2e_tests_lightspeed_evaluation
No overlapping issues found.


Generated by retro agent from #2995

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions