nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-GGUF Image-Text-to-Text • 74B • Updated about 19 hours ago • 26.8k • 73
view post Post 6,916 DeepSeek-V4 can now run locally with Unsloth GGUFs! 🐳Run lossless DeepSeek-V4-Flash on 168GB RAM or3-bit works on 110GB Mac, RAM, VRAM setups.Run via Unsloth Studio or llama.cpp.GGUF: unsloth/DeepSeek-V4-Flash-GGUFGuide: https://unsloth.ai/docs/models/deepseek-v4 See translation 🔥 20 20 🚀 5 5 👍 4 4 🤗 2 2 + Reply
Unsloth Dynamic 2.0 Quants Collection New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance. • 123 items • Updated 9 days ago • 847