Vladimir
vstiff
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
unsloth/Qwen-Image-Layered-GGUF reacted to yanghaojin's post with 🚀 1 day ago
Dear all,
we are happy to share that gbx v0.8.0, our local inference engine for Apple Silicon, runs the 105 GB Qwen3.8-Flash-Next on a 48 GB MacBook Pro by streaming MoE experts from the SSD. When the model fits in memory, it decodes up to 50% faster than omlx, Ollama and mlx-lm on the same Mac, with output identical token for token.
Full write-up: https://medium.com/@semamediadata/running-a-105-gb-qwen-on-a-48-gb-macbook-pro-f116fe493a49
Download gbx: https://github.com/GreenBitAI/gbx-lm/releases
Models: https://huggingface.co/collections/GreenBitAI/greenbitai-for-apple-silicon
liked a model 1 day ago
Qwen/Qwen3.5-397B-A17BOrganizations
None yet