Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's incredibly niche, but Gemma 3 27b can recognize a number of popular video game characters even in novel fanart (I was a little surprised at that when messing around with its vision). But the Q4 quants, even with QAT, are very likely to name a random wrong character from within the same franchise, even when Q8 quants name the correct character.

Niche of a niche, but just kind of interesting how the quantization jostles the name recall.



Vision models do degrade more with quantization. https://unsloth.ai/blog/dynamic-4bit




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: