Skip to content

Commit d3d3899

Browse files
Merge pull request #161 from coder0143:main
PiperOrigin-RevId: 872548217
2 parents bc5c4be + f8a3f81 commit d3d3899

7 files changed

Lines changed: 2766 additions & 0 deletions

File tree

bonsai/models/qwen3_vl/README.md

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
# Qwen3-VL in JAX
2+
3+
This directory contains a pure JAX implementation of the [Qwen3-VL SOTA Vision Language Model](https://github.com/QwenLM/Qwen3-VL), using the [Flax NNX](https://flax.readthedocs.io/en/stable/index.html) API.
4+
5+
6+
## Model Configuration Support Status
7+
8+
| Model Name | Config Support Status |
9+
| :--- | :--- |
10+
| **Dense Models** | |
11+
| [Qwen3-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct) | **✅ Supported** |
12+
| [Qwen3-VL-2B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-2B-Thinking) | **✅ Supported** |
13+
| [Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct) | **✅ Supported** |
14+
| [Qwen3-VL-4B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking) | **✅ Supported** |
15+
| [Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) | **✅ Supported** |
16+
| [Qwen3-VL-8B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-8B-Thinking) | **✅ Supported** |
17+
| [Qwen3-VL-32B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-32B-Instruct) | **✅ Supported** |
18+
| [Qwen3-VL-32B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-32B-Thinking) | **✅ Supported** |
19+
| [NVIDIA-Cosmos-Reason2-2B](https://huggingface.co/nvidia/Cosmos-Reason2-2B) | **✅ Supported** |
20+
| [NVIDIA-Cosmos-Reason2-8B](https://huggingface.co/nvidia/Cosmos-Reason2-8B) | **✅ Supported** |
21+
22+
| **MoE Models** | |
23+
| [Qwen3-VL-30B-A3B](https://huggingface.co/Qwen/Qwen3-30B-A3B) | **🟡 Not started** |
24+
| [Qwen3-VL-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B) | **🟡 Not started** |
25+
26+
27+
### Running this model
28+
29+
Run Qwen3 in action, implemented in [900 lines of code](modeling.py) in JAX.
30+
31+
```sh
32+
python3 -m bonsai.models.qwen3_vl.tests.run_model
33+
```
34+
35+
36+
## How to contribute to this model
37+
38+
We welcome contributions! You can contribute to this model via the following:
39+
* Add a model config variant from the above `🟡 Not started` to `class ModelConfig` in [modeling.py](modeling.py). Make sure your code is runnable on at least one hardware before creating a PR.
40+
* Got some hardware? Run [run_model.py](tests/run_model.py) the existing configs above on hardwares marked `❔ Needs check`. Mark as `✅ Runs` or `⛔️ Not supported`.

bonsai/models/qwen3_vl/__init__.py

Whitespace-only changes.

0 commit comments

Comments
 (0)