Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

440

Base only

Active filters: granite-4.0

cyankiwi/granite-4.0-h-tiny-AWQ-8bit

Text Generation • 3B • Updated 29 days ago • 30

cyankiwi/granite-4.0-h-small-AWQ-4bit

Text Generation • 10B • Updated 29 days ago • 41 • 1

cyankiwi/granite-4.0-h-small-AWQ-8bit

Text Generation • 13B • Updated 29 days ago • 27 • 1

Mungert/granite-4.0-micro-GGUF

3B • Updated Oct 21, 2025 • 31

Mungert/granite-4.0-h-tiny-GGUF

7B • Updated Oct 21, 2025 • 98

Mungert/granite-4.0-h-micro-GGUF

3B • Updated Oct 21, 2025 • 156

Mungert/granite-4.0-micro-base-GGUF

3B • Updated Oct 22, 2025 • 312

RepublicOfKorokke/granite-4.0-h-tiny-mlx-mxfp4

Text Generation • 1B • Updated Oct 23, 2025 • 10

RepublicOfKorokke/granite-4.0-h-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 9

RepublicOfKorokke/granite-4.0-micro-mlx-mxfp4

Text Generation • 0.6B • Updated Oct 23, 2025 • 8

ibm-granite/granite-4.0-350m-GGUF

0.4B • Updated Apr 23 • 1.33k • 9

ibm-granite/granite-4.0-350m-base-GGUF

0.4B • Updated Apr 23 • 410 • 1

ibm-granite/granite-4.0-h-350m-GGUF

0.3B • Updated Apr 23 • 3.01k • 5

ibm-granite/granite-4.0-h-350m-base-GGUF

0.3B • Updated Apr 23 • 478 • 4

ibm-granite/granite-4.0-1b-GGUF

2B • Updated Apr 23 • 2.63k • 5

ibm-granite/granite-4.0-h-1b-GGUF

1B • Updated Apr 23 • 3.25k • 6

ibm-granite/granite-4.0-1b-base-GGUF

2B • Updated Apr 23 • 333 • 3

ibm-granite/granite-4.0-h-1b-base-GGUF

1B • Updated Apr 23 • 596 • 2

onnx-community/granite-4.0-350m-ONNX-web

Text Generation • Updated Oct 28, 2025 • 1.16k • 6

onnx-community/granite-4.0-1b-ONNX-web

Text Generation • Updated Oct 28, 2025 • 212 • 2

ExaltedSlayer/ibm-granite-4.0-h-small-mlx-mxfp4

32B • Updated Oct 26, 2025 • 58 • 1

unsloth/granite-4.0-h-350m

Text Generation • 0.3B • Updated Oct 28, 2025 • 97 • 2

unsloth/granite-4.0-h-350m-GGUF

0.3B • Updated Oct 28, 2025 • 1.67k • 9

unsloth/granite-4.0-350m

Text Generation • 0.4B • Updated Oct 28, 2025 • 548

unsloth/granite-4.0-350m-GGUF

0.4B • Updated Oct 28, 2025 • 3.6k • 8

unsloth/granite-4.0-1b

Text Generation • 2B • Updated Oct 28, 2025 • 704

unsloth/granite-4.0-1b-GGUF

2B • Updated Oct 28, 2025 • 2.64k • 8

unsloth/granite-4.0-h-1b

Text Generation • 1B • Updated Oct 28, 2025 • 42 • 2

unsloth/granite-4.0-h-1b-GGUF

1B • Updated Oct 28, 2025 • 2.19k • 19

unsloth/granite-4.0-h-350m-unsloth-bnb-4bit

Text Generation • 0.3B • Updated Oct 28, 2025 • 99 • 1