QuantLLM/Qwen2.5-7B-Instruct-MLX
8B • Updated • 57
QuantLLM
non-profit
AI & ML interests
QuantLLM is an open-source community exploring AI and ML through practical models and real-world applications.
Recent Activity
View all activity
Organization Card
QuantLLM | The Ultra-Fast LLM Quantization
Welcome to QuantLLM — an open-source community focused on building efficient and accessible AI models. This space hosts our quantized and fine-tuned transformer models, designed for real-world applications and ease of deployment.
models 24
QuantLLM/Qwen2.5-7B-Instruct-ONNX
Updated • 46
QuantLLM/Qwen2.5-7B-Instruct-SafeTensors
8B • Updated • 49
QuantLLM/Qwen2.5-7B-Instruct-GGUF
8B • Updated • 268
QuantLLM/Phi-3.5-mini-instruct-MLX
4B • Updated • 21
QuantLLM/Phi-3.5-mini-instruct-ONNX
Updated
QuantLLM/Phi-3.5-mini-instruct-SafeTensors
4B • Updated • 40
QuantLLM/Phi-3.5-mini-instruct-GGUF
4B • Updated • 136
QuantLLM/TinyLlama-1.1B-Chat-GGUF
1B • Updated • 82
QuantLLM/SmolLM2-135M-QuantLLM
Text Generation • 0.1B • Updated • 20
datasets 0
None public yet