It looks like the frontend is a React SPA. What is the backend stack?
If your backend is is javascript and/or depending on how complicated it is, an easy idea might be to allow users to paste their own OpenAI API token in and have it use that. For various security/privacy reasons it would be ideal if the API calls came directly from the frontend in that case though, and given the caching implementation and other things I'm guessing decoupling that might be pretty challenging. Figured I'd throw out the idea anyway though.
I have a lot of OpenAI API credits to use by end of the month, so I’m using 4o. I’ll probably switch to a more sustainable model afterwards, consider this a request for API credits, all! Email’s on website :)
On a side note, I love the illustration style, some sort of colorful mixed-media collage of UI widgets and physical setting. Does anyone know any similarly-styled documents?
> There’s no official API for ChatGPT yet, so I’m using the unofficial chatgpt NPM package to wire up the app in the demo video. OpenAI has their Cloudflare protection cranked up high; to get around that, it runs a full Chrome instance (!) in the background to shuttle messages back and forth between the little REST API server I wrote and ChatGPT’s internal API.
This is quite a workaround, have you tried the official Davinci003 api? It's rather capable now and probably faster response times. Very cool experiment regardless!
I'm less bullish on specific deadlines for these kinds of notes. I'm planning to do a weekly summary notification - "you made X notes last week, Y of them were high-priority" https://github.com/maxkrieger/voiceliner/issues/20
I have some API credits but I intend to make it sustainable. If any LLM provider wants to sponsor some credits, hit me up.
Otherwise I’ll switch models and add user accounts.