please add kernels for torch==2.13

#1
by vladmandic - opened

please add kernels for torch==2.13

sure!

I have updated the build to cover torch 2.13 in v2 branch now. You could try testing it

rootonchair changed discussion status to closed

thanks! working nicely & integrated into sdnext:
(note that i'm overriding bnb based text-encoder with our sdnq quants)

12:59:55-778162 INFO     Load model: select="Diffusers/lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder [8fdcb1d089]"
12:59:59-020398 DEBUG    Download: type=xet mode="XET" fn="build/torch213-cxx11-cu132-x86_64-linux/_nunchaku_lite_kernels_cuda_c1b1dfd.abi3.so" size=202624464
13:00:12-839261 DEBUG    Module: name=transformer cls=ZImageTransformer2DModel size=3.385 params=3321321536 logical=3321321536 quant=QuantizationMethod.NUNCHAKU_LITE
13:00:12-843160 DEBUG    Module: name=text_encoder cls=Qwen3ForCausalLM size=2.840 params=2321880576 logical=4411424256 quant=QuantizationMethod.SDNQ
13:00:12-845608 DEBUG    Module: name=vae cls=AutoencoderKL size=0.156 params=83819683 logical=83819683 quant=None
13:00:12-846296 INFO     Model class=ZImagePipeline modules=3 size=6.382

It's great to see sdnext adopts the work!

it works really well!
would be great to see most popular models covered
from the new ones, you already have zimage, but missing krea2, klein-9b and anima
and those are by far more popular than flux.1, qwen-image or ernie-image

Sign up or log in to comment