And where are these open source models where I can go to a url and do all the things I can do in ChatGPT or through api keys for OpenAI? I googled a couple of weeks ago to find hosted versions of these open source models to try, and every one was either down or woefully poor.
OpenAI and MS are going to win because they have a package to go and it’s ready and available and working well - they have set the benchmark. I’m not seeing any evidence of this in the OSS community thus far.
Until I can spin up a docker image capable of the same as OpenAI in hetzner for 30 bucks a month - it’s not in the same league.
Hetzner will install any hardware you send them for $100. So you can send them a $200 P40 24GB to run 33B parameter GPU models at ChatGPT speeds without increasing your monthly cost.
One issue with the current generation of open source models is most have been based on some llama core architecture, and that's not licensed for commercial use. Once you get to the point of spinning up a full and easy API, and selling API credentials, you're entering into the commercial clause. Once we have a llama alternative (or a more permissively licensed separate architecture) I guarantee hosting providers like Render or Model are going to come in with an API offering. Just waiting on those core models to improve licensing, would be my guess.
> Until I can spin up a docker image capable of the same as OpenAI in hetzner for 30 bucks a month - it’s not in the same league.
Yes, you are right
That’s irrelevant to the point of this, which is about the dynamics of the market over a longer window than “what is available to use immediately today”, because a “moat” is a different thing than “a current lead”.
OpenAI and MS are going to win because they have a package to go and it’s ready and available and working well - they have set the benchmark. I’m not seeing any evidence of this in the OSS community thus far.
Until I can spin up a docker image capable of the same as OpenAI in hetzner for 30 bucks a month - it’s not in the same league.