Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,687

Base only

Active filters: int4

itzune/berteus-onnx

Feature Extraction • Updated Jul 22 • 14

itzune/gector-eus-onnx

Token Classification • Updated Jul 26 • 9

philipjohnbasile/GLM-5.2-colibri-int4-with-int8-mtp

Updated 16 days ago • 35

Ar4ikov/OmniCoder-9B-AWQ-W4A16-ASYM

Image-Text-to-Text • 10B • Updated Jul 22 • 9 • 2

groxaxo/Nemotron-3-Embed-1B-CoreML-S256-W4A16

Feature Extraction • Updated Aug 22 • 5

Ar4ikov/Ornith-1.0-9B-AWQ-W4A16-ASYM

Text Generation • 10B • Updated Jul 22 • 78 • 1

aximi/qxern-v6-deploy-int4

a1700878328/qwen3-asr-1.7b-onnx-int4

Automatic Speech Recognition • Updated Jul 23 • 6

ep219/GLM-5.2-colibri-int4-with-int8-mtp

Updated Jul 23 • 16

leuconoe/litert-lm-unity-quantized

Text Generation • Updated Jul 26 • 57

ilyaosovskoi/qwopus3.6-35b-a3b-coder-colibri-i4

Updated Jul 25 • 76

soyrsoyr/gemma-4-12b-it-W4A16-GPTQ

13B • Updated Jul 23 • 368

sabrewing-engine/Laguna-S-2.1-colibri-int4

Updated Jul 23 • 48 • 5

WhaletechAI/W2-31B-A3B-dLLM-Base-preview

Text Generation • 31B • Updated Jul 31 • 7 • 6

Colibro/Qwen3.6-35B-INT4-MTP8-MM-F16

Image-Text-to-Text • Updated Jul 24 • 12

Wondernutts/MS3.1-24B-Magnum-Diamond-int4-ov

Text Generation • Updated Jul 26 • 15

Colibro/Qwen-AgentWorld-35B-A3B-INT4

Text Generation • Updated Jul 24 • 16

Irfanuruchi/Qwen3-4B-Computer-Science-AWQ

Text Generation • 4B • Updated Jul 24 • 16

Irfanuruchi/Qwen3-4B-Computer-Science-Models

Text Generation • Updated Jul 25 • 1

sahilchachra/KAT-Coder-V2.5-Dev-W4A16

Text Generation • 35B • Updated Jul 24 • 307 • 1

DogDreamson/picforlater-qwen3-vl-2b-onnx

Image-Text-to-Text • Updated 21 days ago • 1

AIA-YSC/GLM-5.2-colibri-int4-with-int8-mtp

Updated Jul 24 • 17 • 1

MirilAI/Miril-DroneVLM-2B-2-bnb4

Image-Text-to-Text • 5B • Updated Jul 25 • 11

MirilAI/Miril-DroneVLM-2B-2-MLX-4bit

Image-Text-to-Text • 5B • Updated Jul 25 • 13

Irfanuruchi/Qwen3-4B-Computer-Science-OpenVINO-INT4

Text Generation • Updated Jul 25 • 10

AlperKTS/Krea-2-SVDQuant-ComfyUI

Text-to-Image • Updated Aug 24 • 3.8k • 17

hyperhuzaifa/GLM-5.2-colibri-int4-with-int8-mtp

Updated Jul 26 • 13

emb1ter/ACE-Step-v1.5-XL-Turbo-ONNX-WebGPU

Text-to-Audio • Updated Aug 3

sabrewing-engine/Qwen3.5-35B-A3B-sabrewing-int4

Text Generation • Updated Jul 26 • 14

yaoandy107/greyscope-v2-qwen3.5-4b-mlx-4bit

Text Classification • 4B • Updated Jul 28 • 305