Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,776

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 2 days ago • 1.99M • 2.08k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated about 7 hours ago • 68.7k • 218

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 2 days ago • 45.2k • 100

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 13 days ago • 1.02M • 352

InternScience/Agents-A1-Q4_K_M-GGUF

35B • Updated 9 days ago • 44k • 107

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 1 day ago • 7.13k • 45

tencent/Hy3-FP8

Text Generation • 299B • Updated 7 days ago • 11k • 54

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 4 days ago • 15k • 23

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 17 days ago • 988k • 265

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated about 1 month ago • 8.49M • 461

InternScience/Agents-A1-Q8_0-GGUF

35B • Updated 9 days ago • 11.4k • 30

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated May 31 • 4.91M • 321

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 9 days ago • 2.03M • 103

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 3 days ago • 13.4k • 67

nvidia/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Jun 2 • 107k • 41

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated about 1 month ago • 23.4k • 98

empero-ai/Qwable-9B-Claude-Fable-5-GGUF

Image-Text-to-Text • 9B • Updated 24 days ago • 52.6k • 66

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 15 days ago • 41k • 52

Jiunsong/SuperHY3-abliterated-NVFP4

Text Generation • 172B • Updated about 3 hours ago • 8 • 9

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 205k • 532

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 17 days ago • 267k • 60

phaseonx11/GLM-5.2-Uncensored-GGUF

Text Generation • 753B • Updated 6 days ago • 1.94k • 16

Jundot/Qwen3.6-27B-oQ4e-mtp

5B • Updated 5 days ago • 1.83k • 9

kodelow/Hy3-NVFP4-W4A16

Text Generation • 172B • Updated 6 days ago • 6.77k • 12

ALXOPENSOURCE/lingbot-video-1.3b-fp8

Text-to-Video • Updated 3 days ago • 81 • 8

Jiunsong/SuperGLM-5.2-abliterated-NVFP4

Text Generation • 381B • Updated about 3 hours ago • 8

InternScience/Agents-A1-FP8

Text Generation • 35B • Updated 11 days ago • 16k • 18

nvidia/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 84B • Updated 12 days ago • 18.6k • 26

Jundot/Qwen3.6-35B-A3B-oQ4e-mtp

6B • Updated 5 days ago • 1.39k • 8

douyamv/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 9 • 305k • 236