please add kernels for torch==2.13
#1
by vladmandic - opened
please add kernels for torch==2.13
sure!
I have updated the build to cover torch 2.13 in v2 branch now. You could try testing it
rootonchair changed discussion status to closed
thanks! working nicely & integrated into sdnext:
(note that i'm overriding bnb based text-encoder with our sdnq quants)
12:59:55-778162 INFO Load model: select="Diffusers/lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder [8fdcb1d089]"
12:59:59-020398 DEBUG Download: type=xet mode="XET" fn="build/torch213-cxx11-cu132-x86_64-linux/_nunchaku_lite_kernels_cuda_c1b1dfd.abi3.so" size=202624464
13:00:12-839261 DEBUG Module: name=transformer cls=ZImageTransformer2DModel size=3.385 params=3321321536 logical=3321321536 quant=QuantizationMethod.NUNCHAKU_LITE
13:00:12-843160 DEBUG Module: name=text_encoder cls=Qwen3ForCausalLM size=2.840 params=2321880576 logical=4411424256 quant=QuantizationMethod.SDNQ
13:00:12-845608 DEBUG Module: name=vae cls=AutoencoderKL size=0.156 params=83819683 logical=83819683 quant=None
13:00:12-846296 INFO Model class=ZImagePipeline modules=3 size=6.382
It's great to see sdnext adopts the work!
it works really well!
would be great to see most popular models covered
from the new ones, you already have zimage, but missing krea2, klein-9b and anima
and those are by far more popular than flux.1, qwen-image or ernie-image