Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,802

Base only

Active filters: llama-cpp

Abiray/gemma-4-12b-it-GGUF

Any-to-Any • 12B • Updated 6 days ago • 4.01k • 13

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 55.5k • 714

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 1 day ago • 1.3k • 10

spiritbuun/buun-Qwen3.6-chat_template

Updated 12 days ago • 41

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 20 • 14.1k • 91

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 17.1k • 29

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 1 day ago • 4.77k • 14

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 20 • 1.99k • 15

stacksnathan/Qwen3-Coder-Next-80B-APEX-I-Quality-GGUF

Text Generation • 80B • Updated Apr 5 • 738 • 10

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 20 • 2.59k • 20

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated 2 days ago • 350 • 3

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 144 • 9

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 208 • 3

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 18

FinnTheAI/Kimi-K2.6-SmartQuant-GGUF

Text Generation • 1T • Updated 1 day ago • 1.5k • 2

AtomicChat/Qwen3.6-35B-A3B-UDT-MTP-GGUF

36B • Updated 27 days ago • 5.42k • 7

nopesadly/higgs-audio-v3-8b-stt-v2-Q4_K_M-GGUF

Automatic Speech Recognition • 8B • Updated 12 days ago • 180 • 2

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 11 days ago • 6.72k • 12

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated 7 days ago • 2.53k • 4

ijohn07/Holo-3.1-4B-Q6_K-GGUF

Image-Text-to-Text • 5B • Updated 7 days ago • 365 • 2

pabloreyespo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

71B • Updated 6 days ago • 242 • 3

sneedjak/Adelic-Gemma-4-12B-GGUF

Text Generation • 12B • Updated 3 days ago • 20.5k • 2

V15h/PLLaMa-7b-instruct-Q4_K_M-GGUF

7B • Updated Jun 23, 2024 • 19 • 1

elyza/Llama-3-ELYZA-JP-8B-GGUF

8B • Updated Jun 26, 2024 • 2.07k • 74

Tech-Meld/Llama3-ChatQA-1.5-8B-Q4_K_S-GGUF

Text Generation • 8B • Updated Jun 30, 2024 • 31 • 2

Bohanlu/Taigi-Llama-2-Chat-13B-Q4_K_M-GGUF

13B • Updated Aug 14, 2024 • 42 • 1

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 5.51k • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 20.3k • 30

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 41.3k • 24

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 1.82k • 10