Edit Models filters

Model Tree

ibm-granite/granite-4.1-3b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

59

Base only

Active filters: ibm-granite/granite-4.1-3b

WithinUsAI/IBM-Opus4.7-Obscure.Reasoner.3B.GGUF

3B • Updated May 7 • 74 • 3

ddark-il/granite-4.1-3b-optiq

Text Generation • 0.6B • Updated May 13 • 26

HarmenWessels/granite-4.1-3b-int4-cw-ov

Text Generation • Updated Jun 8 • 20

HarmenWessels/granite-4.1-3b-int8-ov

Text Generation • Updated Jun 8 • 7

HarmenWessels/granite-4.1-3b-int4-cw-code-ov

Text Generation • Updated Jun 9 • 8

Dzluck/granite-4.1-3b-GGUF

Text Generation • 3B • Updated Jun 24 • 112

armandosds/granite-4.1-3b-GGUF

Text Generation • 3B • Updated Jul 10 • 55

liodon-ai/granite-4.1-3b-imatrix-GGUF

Text Generation • 3B • Updated Jul 16 • 41 • 1

pharos-one/pharos-judge-free

Text Generation • 3B • Updated Jul 22 • 366 • 2

infohound/ha-voice-granite-3b-GGUF

Text Generation • 3B • Updated 23 days ago • 162

salohcin714/granite-4.1-3b-8bit-mlx

Text Generation • 1.0B • Updated 21 days ago • 63

salohcin714/granite-4.1-3b-8bit-awq-mlx

Text Generation • 0.9B • Updated 21 days ago • 55

salohcin714/granite-4.1-3b-8bit-gptq-mlx

Text Generation • 0.9B • Updated 21 days ago • 81

salohcin714/granite-4.1-3b-6bit-mlx

Text Generation • 0.7B • Updated 21 days ago • 35

salohcin714/granite-4.1-3b-5bit-mlx

Text Generation • 0.6B • Updated 21 days ago • 43

salohcin714/granite-4.1-3b-4bit-mlx

Text Generation • 0.5B • Updated 21 days ago • 47

salohcin714/granite-4.1-3b-4bit-gptq-mlx

Text Generation • 0.5B • Updated 21 days ago • 37

salohcin714/granite-4.1-3b-3bit-mlx

Text Generation • 0.4B • Updated 21 days ago • 44

salohcin714/granite-4.1-3b-3bit-awq-mlx

Text Generation • 0.4B • Updated 21 days ago • 21

salohcin714/granite-4.1-3b-2bit-mlx

Text Generation • 0.3B • Updated 21 days ago • 35

salohcin714/granite-4.1-3b-2bit-awq-mlx

Text Generation • 0.3B • Updated 21 days ago • 18

salohcin714/granite-4.1-3b-2bit-gptq-mlx

Text Generation • 0.4B • Updated 21 days ago • 33

salohcin714/granite-4.1-3b-mxfp8-mlx

Text Generation • 1.0B • Updated 21 days ago • 37

salohcin714/granite-4.1-3b-mxfp4-mlx

Text Generation • 0.6B • Updated 21 days ago • 40

salohcin714/granite-4.1-3b-nvfp4-mlx

Text Generation • 0.9B • Updated 21 days ago • 61

SandLogicTechnologies/granite-4.1-3b-GGUF

3B • Updated 18 days ago • 305

kingjones777/Granite-4.1-3B-ROCmFP4-GGUF

Text Generation • 3B • Updated 6 days ago • 85

kessenma/granite41-3b-german-tutor-v4-4bit

Text Generation • 0.5B • Updated 3 days ago • 49

devpramod-intel/granite-4.1-3b-quantized.w8a8

Text Generation • 4B • Updated about 19 hours ago • 233