Link has all the params but running at 4 bit quant. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		bn-l 10 months ago \| parent \| context \| favorite \| on: The impact of competition and DeepSeek on Nvidia Link has all the params but running at 4 bit quant.

qingcharles 10 months ago [–]

4-bit quant is generally kinda low, right?

I wonder how badly this quant affects the output on DeepSeek?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact