Quantization of Diffusion Model with W4A16 Setting #117
Description
Hi, I was interested in knowing how can I perform SVDQuant with weight-only quantization using INT4 precision while keeping the activation in original precision.
{{ message }}
Hi, I was interested in knowing how can I perform SVDQuant with weight-only quantization using INT4 precision while keeping the activation in original precision.