Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2502.06415

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8

Base only

Active filters: 2502.06415

mratsim/GLM-4.6-EXL3

Text Generation • Updated Nov 16, 2025 • 3 • 4

mratsim/GLM-4.7-EXL3

Text Generation • Updated Apr 17 • 62 • 21

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • 39B • Updated Jan 14 • 51 • 39

mratsim/MiniMax-M2.1-BF16-INT4-AWQ

Text Generation • 39B • Updated Jan 14 • 10 • 7

mratsim/GLM-4.7-Flash-FP8

Text Generation • 31B • Updated Jan 26 • 1.07k • 1

mratsim/MiniMax-M2.5-BF16-INT4-AWQ

Text Generation • 39B • Updated Feb 17 • 4.87k • 43

mratsim/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Feb 17 • 244 • 21

lovethayo/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Apr 20 • 9