Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Paul Graham: Then I noticed it used the word "delve." (twitter.com/paulg)
9 points by someotherperson on April 9, 2024 | hide | past | favorite | 7 comments


It's less the individual words and more the structure of the text. Normal people say delve sometimes, but ChatGPT tends to use a particular structure. You know it when you see it. It seems overly excited, it uses more words than it needs to, it uses overly flowery words (one is OK, but ChatGPT uses them a lot), it ends everything with "It's important to note..."


When they change the seed number we are all doomed because it will be using different words frequently and we will need to re-learn the ones :-)


I am afraid it doesn't work that way as the seed doesn't affect token probabilities. If anything, the temperature setting would be of more use.


Are its outputs in the "ChatGPT style" due to fine-tuning? It does seem to use a specific style that would be relatively uncommon in the data it was trained on, but it might be overrepresented in fine-tuning data.


"Far, far below the deepest delving of the Dwarves, the world is gnawed by nameless things." --Gandalf the White



This is a man who just hasn’t cast Treasure Cruise




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: