Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's how temperature/top_p/top_k work. Anthropic also just put out a paper where they were doing a much more advanced version of this, mapping out functional states within the modern and steering with that.


Huh, I wonder if that's why you cannot change the temperature when thinking is enabled. Do you have a link for the paper?


https://transformer-circuits.pub/2026/emotions/index.html

At the actual inference level temperature can be applied at any time - generation is token by token - but that doesn't mean the API necessarily exposes it.


Thanks. I was referring to the fact that Anthropic, in their API, prohibits setting temperature when thinking is enabled.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: