|
| 1 | +# Qwen3-VL in JAX |
| 2 | + |
| 3 | +This directory contains a pure JAX implementation of the [Qwen3-VL SOTA Vision Language Model](https://github.com/QwenLM/Qwen3-VL), using the [Flax NNX](https://flax.readthedocs.io/en/stable/index.html) API. |
| 4 | + |
| 5 | + |
| 6 | +## Model Configuration Support Status |
| 7 | + |
| 8 | +| Model Name | Config Support Status | |
| 9 | +| :--- | :--- | |
| 10 | +| **Dense Models** | | |
| 11 | +| [Qwen3-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct) | **✅ Supported** | |
| 12 | +| [Qwen3-VL-2B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-2B-Thinking) | **✅ Supported** | |
| 13 | +| [Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct) | **✅ Supported** | |
| 14 | +| [Qwen3-VL-4B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking) | **✅ Supported** | |
| 15 | +| [Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) | **✅ Supported** | |
| 16 | +| [Qwen3-VL-8B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-8B-Thinking) | **✅ Supported** | |
| 17 | +| [Qwen3-VL-32B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-32B-Instruct) | **✅ Supported** | |
| 18 | +| [Qwen3-VL-32B-Thinking](https://huggingface.co/Qwen/Qwen3-VL-32B-Thinking) | **✅ Supported** | |
| 19 | +| [NVIDIA-Cosmos-Reason2-2B](https://huggingface.co/nvidia/Cosmos-Reason2-2B) | **✅ Supported** | |
| 20 | +| [NVIDIA-Cosmos-Reason2-8B](https://huggingface.co/nvidia/Cosmos-Reason2-8B) | **✅ Supported** | |
| 21 | + |
| 22 | +| **MoE Models** | | |
| 23 | +| [Qwen3-VL-30B-A3B](https://huggingface.co/Qwen/Qwen3-30B-A3B) | **🟡 Not started** | |
| 24 | +| [Qwen3-VL-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B) | **🟡 Not started** | |
| 25 | + |
| 26 | + |
| 27 | +### Running this model |
| 28 | + |
| 29 | +Run Qwen3 in action, implemented in [900 lines of code](modeling.py) in JAX. |
| 30 | + |
| 31 | +```sh |
| 32 | +python3 -m bonsai.models.qwen3_vl.tests.run_model |
| 33 | +``` |
| 34 | + |
| 35 | + |
| 36 | +## How to contribute to this model |
| 37 | + |
| 38 | +We welcome contributions! You can contribute to this model via the following: |
| 39 | +* Add a model config variant from the above `🟡 Not started` to `class ModelConfig` in [modeling.py](modeling.py). Make sure your code is runnable on at least one hardware before creating a PR. |
| 40 | +* Got some hardware? Run [run_model.py](tests/run_model.py) the existing configs above on hardwares marked `❔ Needs check`. Mark as `✅ Runs` or `⛔️ Not supported`. |
0 commit comments