Skip to content

Skip Grok in incompatible agent e2e tests - #378

Merged
andy-xu-db merged 1 commit into
mainfrom
fix/skip-grok-e2e
Aug 25, 2026
Merged

Skip Grok in incompatible agent e2e tests#378
andy-xu-db merged 1 commit into
mainfrom
fix/skip-grok-e2e

Conversation

@andy-xu-db

Copy link
Copy Markdown
Collaborator

Summary

  • exclude databricks-grok-* from the Codex, Copilot, and Pi per-model e2e matrices
  • document the observed Bedrock request incompatibility for each agent
  • keep Grok discovery and production behavior unchanged

Testing

  • uv run ruff check tests/test_e2e.py
  • focused assertions verify Grok is filtered while databricks-gpt-5 remains included

The live e2e failures being skipped are deterministic HTTP 400 responses from the Bedrock Grok adapter: incompatible Responses tool schema for Codex, unsupported llm/v1/chat for Copilot, and a bodyless OpenAI 400 for Pi.

@andy-xu-db
andy-xu-db enabled auto-merge (squash) August 24, 2026 20:55
@andy-xu-db
andy-xu-db requested a review from tt-le August 25, 2026 18:35
@andy-xu-db
andy-xu-db merged commit fea369a into main Aug 25, 2026
2 checks passed
@andy-xu-db
andy-xu-db deleted the fix/skip-grok-e2e branch August 25, 2026 18:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants