Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,962

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 16 days ago • 745k • • 1.14k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 17 days ago • 2.57M • 724

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 828k • 1.03k

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 20 days ago • 324k • 201

qvac/VisionPsy-Nano-460M

Image-Text-to-Text • 0.5B • Updated 5 days ago • 777 • 13

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 20 days ago • 319k • 164

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 5 days ago • 78.1k • 62

Cactus-Compute/needle

30.4M • Updated 21 days ago • 1.4k • 320

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 28.5k • 901

FINAL-Bench/POCKET-Image-Zimage

Text-to-Image • 3B • Updated 7 days ago • 105 • 33

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 67.1k • 762

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 123k • 131

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 116k • 222

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 5 days ago • 25.2k • 38

litert-community/Bonsai-Image-ternary-4B

Text-to-Image • Updated about 14 hours ago • 180 • 4

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 46.7k • 86

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 8.34k • 31

PeppX/gemma-4-e2b-uncensored-litertlm

Updated 18 days ago • 2.64k • 14

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated 23 days ago • 718 • 9

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 5 days ago • 3.07k • 34

scrappylabsai/warble

Text-to-Speech • 0.6B • Updated 2 days ago • 29 • 3

runanywhere/silero-vad-v5

Voice Activity Detection • Updated Feb 13 • 8

TheStageAI/gemma-3-1b-it

Text Generation • Updated 5 days ago • 40 • 2

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 18.1k • 54

leoxs22/manga-panel-detector-yolo26n

Object Detection • Updated Mar 30 • 87 • 13

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 2.97k • 89

soniqo/Supertonic-3-ONNX-INT8

Text-to-Speech • Updated Jun 21 • 42 • 2

wenshutang/ternlight

Sentence Similarity • Updated 26 days ago • 7

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated Jun 26 • 585 • 16

TheStageAI/Qwen3-ASR-0.6B

Automatic Speech Recognition • Updated 5 days ago • 3 • 2