Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,058

Base only

Active filters: int4

Abiray/Minimax-H3-nvfp4-INT4-INT8-Convrot

Image-Text-to-Video • Updated about 3 hours ago • 34

Audio8/Audio8-TTS-Preview-0.6B-ONNX-INT4

Text-to-Speech • Updated 1 day ago • 54 • 31

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated 11 days ago • 1.19k • 40

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated 3 days ago • 1.06k • 43

mastouri/GLM-5.2-colibri-int4-g64-with-int8-mtp

Updated 1 day ago • 3.21k • 29

mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp

Updated 21 days ago • 12.6k • 136

vessl/Kimi-K3-W4AFP8

Image-Text-to-Text • 1.4T • Updated 1 day ago • 741 • 11

AlperKTS/Krea-2-SVDQuant-ComfyUI

Text-to-Image • Updated 2 days ago • 658 • 10

vovaRL/NanoColibri-Instruct

Text Generation • 3B • Updated 5 days ago • 96 • 8

jlnsrk/GLM-5.2-colibri-int4

Updated 16 days ago • 12.6k • 160

Winnougan/INT4-Convrot-Comfy-Models

Updated 20 days ago • 57

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 771k • 129

annelo/GLM-5.2-FP8-Uncensored-Colibri-Int4

Text Generation • Updated 15 days ago • 1.41k • 10

josefprusa/ThinkingCap-Qwen3.6-27B-int4-AutoRound-v1

Text Generation • 6B • Updated 28 days ago • 12.3k • 50

Sparknight/sam3.1-int8-int4-convrot

Image Segmentation • Updated 3 days ago • 3

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 14 days ago • 49.4k • 43

bleysg/Qwen3.5-122B-A10B-int4-fp8-hybrid

Text Generation • 20B • Updated Jun 24 • 48.4k • 7

lowbitcoffee/GLM-5.2-W4A16

Text Generation • 101B • Updated about 1 month ago • 1.62k • 4

ariaotp/INT4-ConvRot-W4A4-ComfyUI

Updated 13 days ago • 28

canada-quant/hy3-w4a16-mtp

Text Generation • 47B • Updated 17 days ago • 1.87k • 5

WhaletechAI/W2-31B-A3B-dLLM-Base-preview

Text Generation • 31B • Updated 3 days ago • 7 • 2

Rakuten/RakutenAI-7B-chat-onnx

Updated 6 days ago • 12 • 2

RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Apr 22, 2025 • 3.11k • 4

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 2.86k • 9

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 64.3k • 30

atbender/Qwen3.6-VL-REAP-26B-A3B-W4A16

Text Generation • 1B • Updated Apr 19 • 523 • 7

appmana/deepseek-v4-int4-int8

168B • Updated 1 day ago • 559 • 3

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 19.5k • 18

ayysasha/MiniMax-M2.7-AWQ-G32-STRIX-2H

Text Generation • 51B • Updated May 19 • 926 • 10

bowmanslayer/Qwen3.6-27B-Text-Only-W4A16-g128-ToolCalling

Text Generation • Updated May 22 • 1