Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

101

Base only

Active filters: w4a4

protoLabsAI/Qwythos-9B-v2-NVFP4

Text Generation • 7B • Updated Jul 12 • 8.35k • 2

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0060

Text Generation • 31B • Updated Jul 12 • 141

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0195

Text Generation • 31B • Updated Jul 12 • 101

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0330

Text Generation • 31B • Updated Jul 12 • 119

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0475

Text Generation • 31B • Updated Jul 12 • 144

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0620

Text Generation • 31B • Updated Jul 12 • 153

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0730

Text Generation • 31B • Updated Jul 12 • 166

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0815

Text Generation • 31B • Updated Jul 12 • 171

WaveCut/Ideogram-v4-Instant-OrbitQuant-W4A4

Text-to-Image • 5B • Updated Jul 14 • 9 • 1

vroomfondel/glm-5.2-reap-504B-v2-W4A4

Text Generation • 285B • Updated 28 days ago • 348 • 1

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated 24 days ago • 172 • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 23 days ago • 3

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 23 days ago • 5

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated 23 days ago

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 16B • Updated 22 days ago • 39

sakamakismile/Solar-Open2-250B-NVFP4A16

142B • Updated 22 days ago • 60 • 1

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s2640

Text Generation • 16B • Updated 21 days ago • 33

felipesztutman/krea-realtime-video-14b-w4a4

Text-to-Video • Updated 21 days ago

JasonW2025/Laguna-S-2.1-ModelOpt-NVFP4-W4A4-vllm

Text Generation • 61B • Updated 3 days ago • 355 • 3

CocaKova/Qwythos-27B-v1-NVFP4

Image-Text-to-Text • 27B • Updated 16 days ago • 478

ajh-code/Mage-VL-XPO3-NVFP4-W4A4

Image-Text-to-Text • 3B • Updated 13 days ago • 355

maci0/ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 27B • Updated 11 days ago • 347

ModelsLab/Krea-2-Turbo-W4A4-Nunchaku

Text-to-Image • Updated 12 days ago • 2

kkuspa/Laguna-S-2.1-NVFP4-0804

Text Generation • 118B • Updated 9 days ago • 1.95k • 5

WaveCut/MiniMax-H3-OrbitQuant-W4A4

Image-Text-to-Video • 17B • Updated 10 days ago • 67 • 2