If you'd read the source you linked you'd see that no, the system is inherently ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		squeaky-clean on Sept 11, 2023 \| parent \| context \| favorite \| on: Advanced NLP with SpaCy If you'd read the source you linked you'd see that no, the system is inherently non-deterministic. They cannot sell you a deterministic version of GPT-4. There is no such thing. They could sell you a deterministic version of some other inferior model.

yorwba on Sept 11, 2023 [–]

From the source, which I read:

As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level

They could sell you a version where you shove in a whole batch, pay $batch_size as much, and always get the same result for the same batch.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact