Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,674

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 16 days ago • 745k • • 1.14k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 17 days ago • 2.57M • 723

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 56.6k • 135

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 37.6k • 59

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 17.9k • 115

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated 12 days ago • 9.26k • 22

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.04k • 276

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 67.1k • 762

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 123k • 131

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 13k • 67

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 46.7k • 86

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 8.34k • 31

Youssofal/Qwen3.6-27B-Abliterated-Heretic-Uncensored-GGUF

Text Generation • 27B • Updated Apr 30 • 17.1k • 27

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 5 days ago • 18.5k • 72

CEAMFA/palmer-007-preview

Text Generation • 91.1M • Updated 1 day ago • 14 • 3

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 5, 2024 • 15.8k • 51

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 464 • 52

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 7.4k • 14

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 5.56k • 2

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated Mar 3 • 657 • 10

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 18.1k • 54

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 192 • 12

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 22

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 59

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 16 days ago • 14.7k • 17

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 21 days ago • 13.7k • 18

Blackfrost-AI/PINQWEN-3.5-9B-1M-GGUF

Text Generation • 9B • Updated 8 days ago • 1.25k • 2

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated 17 days ago • 1.24k • 4

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated 14 days ago • 15

jinaai/jina-reranker-v3.5-GGUF

Text Ranking • 0.6B • Updated 4 days ago • 1.61k • 2