Depends on your usage, I guess. I personnaly couldn't justify it. In the last few weeks, I've used the API extensively and total cost comes to a few dollars max.
Admittedly, the API doesn't provide nearly as many features as ChatGPT Plus does. To each their own !
> Admittedly, the API doesn’t provide nearly as many features as ChatGPT Plus does.
A lot of the ChatGPT Plus features are features of the wrapper rather than the model, sure. Then again, that’s what things like Langchain are for, right?
You know you can use phind.com with GPT4 access in both expert and creative mode? It's fine-tuned for writing code, but it's good for other stuff, too. Or do you mean API access? There is a form to fill out and they seem to be pretty generous with handing out access.
Got off the waitlist for GPT4 the other day and have been experimenting with it a bunch for coding tasks (generation, review, planning, bug fixing etc.). I prefer 3.5 for the speed and cost and move to 4 for accuracy / detail when necessary.
i have been using it for some time. Great, but it has a tendency to give short answers and don't use the full context available. even if you set the max response size to 20k.
Comparing it to pasting code into GPT4 (the chat interface), how much better is it? I can't wait to see what this can do when an entire codebase can be held within the context window.
Yeah, it can help with some things, but if you ask it to, say, convert a python app to Go, even with plenty of context it will give you hints without full implementation.
I suppose they favored concise answers in the fine tunning process and reused the model to train the 32k.
Things that I have been doing: paste full table DDL with entities and other classes involved and asking for some refactoring of a class. Also that and some stacktraces. It definitely helps, but the price (at least on azure) make me think twice before using.
Admittedly, the API doesn't provide nearly as many features as ChatGPT Plus does. To each their own !