Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
iknownthing
on May 30, 2024
|
parent
|
context
|
favorite
| on:
Show HN: ChatGPT UI for rabbit holes
Are you paying for the API calls yourself here?
maxkrieger
on May 30, 2024
|
next
[–]
I have a lot of OpenAI API credits to use by end of the month, so I’m using 4o. I’ll probably switch to a more sustainable model afterwards, consider this a request for API credits, all! Email’s on website :)
Falimonda
on May 30, 2024
|
prev
[–]
It seems like they're caching information/replies on key words which is a good optimization.
iknownthing
on May 30, 2024
|
parent
[–]
I assumed it was coming straight from the API because of the token-by-token generation effect but maybe you're right.
rodiger
on May 30, 2024
|
root
|
parent
[–]
The token-by-token responses are probably API, while the "instant" loads seem to be cached.
Probably using groq based on speed of response
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
