Skip to content

[INC-302] Add Gemma 4 to inference#2227

Draft
dkosowski87 wants to merge 8 commits intomainfrom
INC-302/gemma4-support
Draft

[INC-302] Add Gemma 4 to inference#2227
dkosowski87 wants to merge 8 commits intomainfrom
INC-302/gemma4-support

Conversation

@dkosowski87
Copy link
Copy Markdown
Contributor

@dkosowski87 dkosowski87 commented Apr 13, 2026

WIP

@dkosowski87 dkosowski87 changed the title [WIP] [INC-302] Add Gemma 4 to inference Apr 13, 2026
- Introduced new configuration parameters for Gemma 4, including max new tokens, sampling options, and temperature settings.
- Registered multiple Gemma 4 model variants in the models registry.
- Added Gemma 4 multimodal model implementation in `gemma4_hf.py`.
- Created an `__init__.py` for the Gemma 4 module.
- Added unit tests to verify model resolution for Gemma 4 variants.
- Introduced a new example configuration file for Gemma 4 model.
- Added a script to run Gemma 4 locally, demonstrating end-to-end inference with a sample image.
- Included instructions for using the script with both hosted and local model setups.
@dkosowski87 dkosowski87 force-pushed the INC-302/gemma4-support branch from 65d38ff to 89c294c Compare April 15, 2026 14:38
- Created `__init__.py` files for the examples directory and the Gemma 4 module.
- Added `count_backpacks.py` script demonstrating end-to-end inference with the Gemma 4 model using a sample image.
- Included prompts and instructions for running the example locally.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant