Skip to content

[codex] add qwen3.5-4b inference example#48

Open
Fatemanx wants to merge 1 commit into
SandAI-org:mainfrom
Fatemanx:feat/qwen35-4b-inference-example
Open

[codex] add qwen3.5-4b inference example#48
Fatemanx wants to merge 1 commit into
SandAI-org:mainfrom
Fatemanx:feat/qwen35-4b-inference-example

Conversation

@Fatemanx

@Fatemanx Fatemanx commented Jul 21, 2026

Copy link
Copy Markdown

🗂️ PR Category

  • ✨ New Feature

📝 Description

Add a forward-only Qwen3.5-4B inference example under example/inference/qwen3.5-4b.

What changed

  • Adds infer.py, infer.sh, modeling.py, and a short README for the new example.
  • Keeps only the minimal compiled entrypoints: text_prefill, text_decode, image_prefill, image_decode, and all.
  • Requires MODEL_PATH from the environment; no local weight path, GPU id, or Cutlass default is baked in.
  • Follows the same minimal VAE-style wrapper pattern already used by the repo's inference examples.

Validation

  • python -m py_compile example/inference/qwen3.5-4b/infer.py example/inference/qwen3.5-4b/modeling.py
  • bash -n example/inference/qwen3.5-4b/infer.sh
  • pytest tests/example_inference/test_qwen35_4b_infer.py -q -> 6 passed

@Fatemanx Fatemanx changed the title [codex] add qwen3.5-4b inference example add qwen3.5-4b inference example Jul 21, 2026
@Fatemanx Fatemanx changed the title add qwen3.5-4b inference example [codex] add qwen3.5-4b inference example Jul 21, 2026
@Fatemanx
Fatemanx marked this pull request as ready for review July 21, 2026 12:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant