Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> When comparing the cost of an H100 GPU per hour and calculating cost of tokens, it seems the OpenAI offering for the latest model is 5 times cheaper than renting the hardware.

How did you come to that conclusion? That would be a very notable result if it did turn out OpenAI were selling tokens for 5x the cost it took to serve them.



I am reading it as OpenAI selling them for 20% of the cost to serve them (serving at the equivalent token/s with cloud pay-per-use GPUs).


You're right, I misunderstood.


it seems to me they are saying the opposite




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: