Skip to content

feat:support new model:chroma - #928

Open
tonera wants to merge 2 commits into
nunchaku-ai:mainfrom
tonera:feat/chroma
Open

feat:support new model:chroma#928
tonera wants to merge 2 commits into
nunchaku-ai:mainfrom
tonera:feat/chroma

Conversation

@tonera

@tonera tonera commented Apr 3, 2026

Copy link
Copy Markdown

Summary

Add NunchakuChromaTransformer2dModel to support SVDQuant-quantized Chroma model inference.

Features

  • from_pretrained loads single-file safetensors checkpoint with automatic precision/rank inference
  • Dual-stream and single-stream transformer blocks with SVDQW4A4 quantized linear layers
  • Attention mask folding fast-path for flash attention compatibility
  • CPU offload support via set_offload()
  • Accelerate sequential_cpu_offload hook compatibility

Test plan

  • End-to-end image generation with svdq-fp4_r32-Chroma1-HD.safetensors/svdq-int4_r32-Chroma1-HD.safetensors

Download:https://huggingface.co/tonera/Chroma1-HD-SVDQ

@klionclinkz

Copy link
Copy Markdown

Can this please be approved and provide Chroma Support for Nunchaku?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants