Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

83

Base only

Active filters: w4a4

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated 20 days ago • 9.78k • 33

ariaotp/INT4-ConvRot-W4A4-ComfyUI

Updated 11 days ago • 28

neroued/Qwen3.6-27B-nvfp4-NInfer

Image-Text-to-Text • Updated 2 days ago • 136 • 3

maci0/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NVFP4

Image-Text-to-Text • 39B • Updated about 12 hours ago • 1.9k • 11

JasonW2025/Laguna-S-2.1-ModelOpt-NVFP4-W4A4-vllm

Text Generation • 61B • Updated 3 days ago • 47 • 2

maci0/Ornith-1.0-35B-abliterated-NVFP4

Image-Text-to-Text • 35B • Updated about 12 hours ago • 475 • 1

protoLabsAI/Qwythos-9B-v2-NVFP4

Text Generation • 7B • Updated 21 days ago • 9.38k • 2

vroomfondel/glm-5.2-reap-504B-v2-W4A4

Text Generation • 285B • Updated 15 days ago • 277 • 1

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated 11 days ago • 86 • 2

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4

Text Generation • 8B • Updated Sep 3, 2024 • 8 • 1

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 35

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 8

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 134

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Feb 22 • 6

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated Mar 5 • 6

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Mar 5 • 6

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 13

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-NVFP4-GB10

Text Generation • 79B • Updated Apr 17 • 1.1k • 4

Ex0bit/Qwen3.6-35B-A3B-PRISM-NVFP4

Text Generation • Updated May 3 • 28.7k • 20

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 799 • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 82 • 1

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

ultranationalism/nunchaku-z-image-turbo-svdq

Text-to-Image • 4B • Updated May 24 • 1

pyloxsystems/hochelaga-8b-nvfp4

Text Generation • 5B • Updated Jun 24 • 12

dangvansam/chandra-ocr-2-NVFP4

Image-Text-to-Text • 3B • Updated May 26 • 2.28k

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-mse

21B • Updated May 31 • 9

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated May 31 • 8

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated May 31 • 10

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated May 31 • 6

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated May 31 • 18.3k