Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The authors study a bunch of wild low rank fine tunes and discover that they share a common... low rank! ... substructure which is itself base model dependent. Humans are (genetically) the same. You need only a handful of PCs to represent the cast majority of variation. But that's because of our shared ancestry. And maybe the same thing is going on here.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: