Hardware and cost is assumed to be approximately desktop-class. If you've got a ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		regularfry 5 months ago \| parent \| context \| favorite \| on: Qwen3-235B-A22B-Thinking-2507 Hardware and cost is assumed to be approximately desktop-class. If you've got a gaming rig with an RTX 4090 and 128MB RAM, you can run this if you pick the right quant.

cmpxchg8b 5 months ago [–]

128MB? Quantization has come a long way!

danielhanchen 5 months ago | [–]

I think they mis-spoke 128GB* :)

regularfry 5 months ago | | [–]

Wishful thinking there on my part.

danielhanchen 5 months ago | | [–]

Though technically < 1GB is enough - one had offload it to the SSD, albeit with very slow speeds!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact