Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Same problem with normal sampling - if it doesn't pick the <end> token, you're stuck generating until you hit some stopping heuristic (max tokens, timeout, etc.)


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: