Skip to content

fix: handle unrecognized JumpStart container images in ModelBuilder#5818

Open
lhnealreilly wants to merge 1 commit intoaws:masterfrom
lhnealreilly:fix/jumpstart-default-model-server
Open

fix: handle unrecognized JumpStart container images in ModelBuilder#5818
lhnealreilly wants to merge 1 commit intoaws:masterfrom
lhnealreilly:fix/jumpstart-default-model-server

Conversation

@lhnealreilly
Copy link
Copy Markdown

Collapse endpoint mode routing into a single code path since all JumpStart builders (DJL, TGI, MMS) perform identical operations for endpoint deployment. Unknown container images (e.g. vLLM) now pass through instead of raising ValueError.

For local container mode, unrecognized images raise ValueError with a message directing users to use SAGEMAKER_ENDPOINT mode.

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@lhnealreilly lhnealreilly force-pushed the fix/jumpstart-default-model-server branch from c4a18e7 to 7ee1044 Compare May 1, 2026 16:24
@lhnealreilly lhnealreilly force-pushed the fix/jumpstart-default-model-server branch from 7ee1044 to 471e1fb Compare May 1, 2026 16:26
Collapse endpoint mode routing into a single code path since all
JumpStart builders (DJL, TGI, MMS) perform identical operations
for endpoint deployment. Unknown container images (e.g. vLLM) now
pass through instead of raising ValueError.

For local container mode, unrecognized images raise ValueError with
a message directing users to use SAGEMAKER_ENDPOINT mode.
@lhnealreilly lhnealreilly force-pushed the fix/jumpstart-default-model-server branch from 471e1fb to f48a573 Compare May 1, 2026 17:20
Copy link
Copy Markdown
Collaborator

@aviruthen aviruthen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Will investigate CI failures should confirm what they are before merging

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants