Skip to content

Validate new AI sample tests#49214

Open
jpalvarezl wants to merge 3 commits into
kaylieee/release/2.1.0from
jpalvarezl/fix/tests_2_1_0
Open

Validate new AI sample tests#49214
jpalvarezl wants to merge 3 commits into
kaylieee/release/2.1.0from
jpalvarezl/fix/tests_2_1_0

Conversation

@jpalvarezl
Copy link
Copy Markdown
Member

@jpalvarezl jpalvarezl commented May 19, 2026

Summary

  • Enables playback/record coverage for sample tests that pass live validation.
  • Records and publishes assets for:
    • ToolboxSamplesTests in azure-ai-agents
    • hosted-agent session and session-file tests in azure-ai-agents
    • skill package and model-list sample tests in azure-ai-projects
  • Keeps blocked sample flows present as tests but disabled, with updated reasons.
  • Adds hosted-agent preview opt-in headers for session create/get/list/delete sample paths.

Validation

  • mvn -f sdk/ai/pom.xml -pl azure-ai-projects -am -DskipTests test-compile
  • mvn -f sdk/ai/azure-ai-agents/pom.xml -DskipTests test-compile
  • mvn -f sdk/ai/azure-ai-agents/pom.xml -DskipTests checkstyle:check
  • mvn -f sdk/ai/azure-ai-projects/pom.xml -DskipTests checkstyle:check
  • AZURE_TEST_MODE=LIVE mvn -f sdk/ai/azure-ai-agents/pom.xml -Dtest=CodeAgentSamplesTests,HostedAgentContainerSamplesTests,ToolboxSamplesTests,FabricIQSamplesTests test
  • AZURE_TEST_MODE=LIVE mvn -f sdk/ai/azure-ai-projects/pom.xml -Dtest=SamplesTests test
  • AZURE_TEST_MODE=RECORD mvn -f sdk/ai/azure-ai-agents/pom.xml -Dtest=ToolboxSamplesTests test
  • AZURE_TEST_MODE=RECORD mvn -f sdk/ai/azure-ai-agents/pom.xml -Dtest=HostedAgentContainerSamplesTests test
  • AZURE_TEST_MODE=RECORD mvn -f sdk/ai/azure-ai-projects/pom.xml -Dtest=SamplesTests test
  • AZURE_TEST_MODE=PLAYBACK mvn -f sdk/ai/azure-ai-agents/pom.xml -Dtest=CodeAgentSamplesTests,HostedAgentContainerSamplesTests,ToolboxSamplesTests,FabricIQSamplesTests test
  • AZURE_TEST_MODE=PLAYBACK mvn -f sdk/ai/azure-ai-projects/pom.xml -Dtest=SamplesTests test

Work-resource findings

  • foundry-sdk-swedencentral/java was loaded first as requested.
  • foundry-sdk-swedencentral hosted-agent images failed provisioning across all checked flavors.
  • foundry-sdk-test6 hosted-agent images failed provisioning across all checked flavors.
  • foundry-sdk-deployment hosted-agent images became active for base, net, py, and superset; the hosted-agent recordings use the base image with the Java endpoint.
  • FABRIC_IQ_PROJECT_CONNECTION_ID was not present in any flavor of the three checked resources. Similar FABRIC_PROJECT_CONNECTION_ID exists.

Still missing / blocked

Area Status Reason
Code agent samples Disabled Live service returned 403 forbidden: Direct code deployment is not enabled for this subscription.
Hosted-agent endpoint and log-stream samples Disabled Agent-scoped OpenAI Responses invocation returns 400: API version not supported. Hosted session/session-file flows are now enabled and recorded.
FabricIQ samples Disabled FABRIC_IQ_PROJECT_CONNECTION_ID is not present in any of the three checked resources/flavors. Aliasing FABRIC_PROJECT_CONNECTION_ID got past env lookup but exposed service/client shape issues, so this remains blocked pending a real FabricIQ connection and confirmed API shape.
Data generation job list/create samples Disabled Live service returned 400: API operation not supported for token authentication for DataGenerationJobs_List.
Model asset create/update/delete sample Disabled Required model asset env vars are not available: FOUNDRY_MODEL_ASSET_NAME, FOUNDRY_MODEL_ASSET_VERSION, FOUNDRY_MODEL_BLOB_URI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant