Edit Models filters

Model Tree

ibm-granite/granite-4.1-3b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48

Base only

Active filters: ibm-granite/granite-4.1-3b

ibm-granite/granite-4.1-3b-GGUF

Text Generation • 3B • Updated Apr 20 • 236k • 10

unsloth/granite-4.1-3b-GGUF

3B • Updated Apr 30 • 5.02k • 19

callmefattyy/IBM4.1-Unnoticed.Thinker.Uncensored-3B.gguf

Updated May 4 • 344 • 2

ibm-granite/granite-4.1-3b-fp8

Text Generation • 4B • Updated Apr 21 • 1.77k • 8

phoenix-gurl/granite-4.1-3b-Q4_K_M-GGUF

3B • Updated Apr 29 • 50

RepublicOfKorokke/granite-4.1-3b-oQ4-fp16

0.6B • Updated Apr 29 • 10

RepublicOfKorokke/granite-4.1-3b-oQ5-fp16

0.7B • Updated Apr 29 • 14

bartowski/ibm-granite_granite-4.1-3b-GGUF

Text Generation • 3B • Updated Apr 29 • 3.01k • 7

nightmedia/granite-4.1-3b-mxfp8-mlx

Text Generation • 1.0B • Updated Apr 30 • 13

Prince-1/Granite-4.1-3b-Onnx

NikolayKozloff/granite-4.1-3b-Q8_0-GGUF

3B • Updated Apr 30 • 8 • 1

onnx-community/Granite-4.1-3b-Onnx

mlx-community/granite-4.1-3b-nvfp4

Text Generation • 0.9B • Updated Apr 30 • 44 • 1

mlx-community/granite-4.1-3b-mxfp4

Text Generation • 0.6B • Updated Apr 30 • 895 • 4

mlx-community/granite-4.1-3b-mxfp8

Text Generation • 1.0B • Updated Apr 30 • 63 • 1

xprilion/granite-4.1-3b-hindi-lora

4B • Updated May 1 • 5

MiCkSoftware/Granite-4.1-3b-Onnx-q4

Text Generation • Updated May 1

DevQuasar/ibm-granite.granite-4.1-3b-GGUF

Text Generation • 3B • Updated May 1 • 47

Jeethu/granite-4.1-3b-PARO

Text Generation • 0.7B • Updated May 1 • 6

mlx-community/granite-4.1-3b-4bit

Text Generation • 0.6B • Updated May 1 • 240

mlx-community/granite-4.1-3b-5bit

Text Generation • 0.7B • Updated May 1 • 30

mlx-community/granite-4.1-3b-6bit

Text Generation • 0.9B • Updated May 1 • 36

mlx-community/granite-4.1-3b-8bit

Text Generation • 1B • Updated May 1 • 30

lmstudio-community/granite-4.1-3b-GGUF

3B • Updated May 6 • 3.52k

huihui-ai/Huihui-granite-4.1-3b-abliterated

Text Generation • 3B • Updated May 3 • 554 • 5

WithinUsAI/IBM4.1-Unnoticed.Thinker.Uncensored-3B.gguf

3B • Updated May 3 • 107 • 3

mradermacher/granite-4.1-3b-GGUF

3B • Updated May 5 • 57 • 1

mradermacher/granite-4.1-3b-i1-GGUF

3B • Updated May 5 • 186 • 1

cyankiwi/granite-4.1-3b-AWQ-INT4

Text Generation • 4B • Updated 9 days ago • 4.51k

WithinUsAI/IBM-Opus4.7-Obscure.Reasoner.3B.GGUF

3B • Updated May 7 • 76 • 3