Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This would likely run fine in just 96 GB of VRAM, by my estimation. Well within the ability of an enthusiastic hobbyist with a few thousand dollars of disposable income.

Quantizations are already out: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: