Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,616

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 11 days ago • 4.19M • 2.51k

SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF

Image-Text-to-Text • 177B • Updated 4 days ago • 369k • 124

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 2.1M • 1.19k

SC117/Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF

Image-Text-to-Text • 177B • Updated 3 days ago • 45.3k • 39

Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF

Text Generation • 27B • Updated 19 days ago • 50.1k • 134

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 24.1k • 181

pottokao/Qwen-Image-2.1-PE-I2I-Heretic-GGUF

9B • Updated 13 days ago • 57.4k • 36

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 57k • 238

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 420k • 889

SkyIsNotGreen/Scion-35B-A3B

Text Generation • 35B • Updated 1 day ago • 2.06k • 11

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.71k • 10

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Aug 31 • 616k • • 1.41k

pottokao/Qwen-Image-2.1-PE-T2I-Heretic-GGUF

9B • Updated 13 days ago • 53.6k • 49

Eliasfpv28/Kolibri-1-Q3_K_S-GGUF

Text Generation • 78B • Updated 4 days ago • 1.12k • 5

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 372k • 167

NANI-Nithin/K2-Horizon-MoVA-36B-A4B-GGUF

Text Generation • 37B • Updated Sep 5 • 34.6k • 43

TokenRhythm/NeoHorse-1-4B-GGUF

Text Generation • 4B • Updated 27 days ago • 43k • 47

prithivMLmods/Orion-9B-Agentic-CodeCore-Merge-GGUF

Text Generation • 9B • Updated 12 days ago • 1.53k • 7

aemmeath/NasledieLab-Qwen3.5-0.8B-GPT-6-Astra-Luna-Fable-5.1-Opus-5.5-distill-Karpy-GGUF

0.8B • Updated 10 days ago • 5.15k • 10

prithivMLmods/clef-flash-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 1.15k • 4

israellaguan/TinyLlama_V1.1_Tree_of_thoughts-Q8_0-GGUF

1B • Updated Sep 19, 2024 • 114 • 9

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 790

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.41k • 87

Justbackup/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated Aug 20 • 1.31k • 4

SC117/Spark-X2.5-4B-abliterated-FIT-GGUF

Text Generation • 4B • Updated 4 days ago • 37.2k • 30

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 19 days ago • 94.7k • 158

SC117/occamy-1.0-abliterated-FIT-GGUF

Image-Text-to-Text • 35B • Updated 4 days ago • 14.5k • 12

Ninnix96/Qwengram-0.8B

Text Generation • 0.8B • Updated 9 days ago • 3.66k • 15

godolike/deepseek-coder-6.7b-instruct-Q4_K_M-GGUF

7B • Updated Jul 18, 2024 • 430 • 3

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3.27k • 14