Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,711

Base only

Active filters: int4

sabrewing-engine/Inkling-Gutenberg-DPO-colibri-int4

Updated Jul 18 • 24 • 2

Nabhos/Lehja-RP-Gemma-4-26B-A4B-v0.1-AWQ

Text Generation • 27B • Updated Jul 20 • 25

RelativeDB/rt-j-int4

Tabular Classification • Updated Jul 18

owensong/chatterbox-nano-ONNX

Text-to-Speech • Updated Jul 19 • 206 • 6

okayuji/gemma-4-12b-it-coreml-128k

Text Generation • Updated Jul 21 • 16 • 1

nadare/CAT-Translate-0.8b-onnx-q4-k-quant

Translation • Updated Jul 19

wasifb/Tess-4-27B-AutoRound-W4A16-club3090

3B • Updated Jul 20 • 19 • 1

konic-labs/LFM2.5-8B-A1B-REAP-50-AWQ-INT4

Text Generation • 5B • Updated Jul 20 • 17

groxaxo/qwen3-1.7b-coreml-int8

Text Generation • Updated Aug 22 • 38 • 1

leafmoone/RUM-FLUX.2-klein-4B-ConvRot-Quantized

Image-to-Image • Updated Jul 20 • 35 • 1

yaoandy107/greyscope-v2-qwen3.5-4b-int4

Text Classification • 1B • Updated Jul 28 • 123

GaelicThunder/Qwen3.5-122B-A10B-heretic-hybrid-int4fp8

Text Generation • 21B • Updated Jul 20 • 232

antonyMox/Qwen3.6-27B-abliterated-AutoRound-INT4-MTP

Text Generation • 6B • Updated Jul 20 • 171 • 1

SearchingMan/FLUX.1-dev-ConvRot

Text-to-Image • Updated Jul 22 • 3

massif/Qwen3-1.7B-CoreAI-GPU-INT4-4K-h16p

Text Generation • Updated Jul 20 • 1

antonyMox/Qwen3.6-27B-AutoRound-INT4-wide-MTP

Text Generation • 11B • Updated Jul 20 • 23

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated Jul 23 • 1.63k • 40

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated Jul 31 • 100 • 43

Wondernutts/Gemma-4-26B-A4B-StyleTune-V2-int4-ov

Image-Text-to-Text • Updated 21 days ago • 59

Wondernutts/Lumimaid-Magnum-v4-12B-int4-ov

Text Generation • Updated Jul 26 • 8

Wondernutts/magnum-v4-12b-int4-ov

Text Generation • Updated Jul 26 • 13

wilherman2121/Audex-30B-A3B-W4A16

7B • Updated Jul 21 • 9

wilherman2121/Audex-30B-A3B-W4A16-v2

7B • Updated Jul 21 • 12

Wondernutts/Gemma-4-31B-StyleTune-int4-ov

Image-Text-to-Text • Updated Jul 26 • 8

DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-opset24-c056-cpu

Automatic Speech Recognition • Updated Jul 21

DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-opset24-c112-cpu

Automatic Speech Recognition • Updated Jul 21

Wondernutts/Qwen3.6-35B-A3B-StyleTune-int4-ov

Image-Text-to-Text • Updated Jul 24 • 7

LostGentoo/LFM2.5-8B-A1B-AWQ-INT4-agentic

Text Generation • 9B • Updated Jul 21 • 94

PhalaCloud/GLM-5.2-W4A8-CT

Text Generation • 116B • Updated Jul 22 • 58

Distillio/GLM-5.2-colibri-int4-with-int8-mtp

Updated Jul 22 • 18