possible to have quantized version
#2
by jar67 - opened
Many others and I have 16GB Vram. A quantized version would be great.
I have tried Moss-Audio understanding model...so amazing!
Thanks for the feedback!
We plan to release a quantized MOSS-VL version that runs within 24GB VRAM first. We’re also aware that many users have 16GB GPUs, and we’ll continue optimizing and validating support for 16GB VRAM in a future release.