> Well, isn't it time we started doing the same with LLMs? I'm not talking about MCP, but rather an open source tool that can plug into either free and open source LLMs or private ones.

Almost all providers and models can be used with the OpenAI api and swapping between them is trivial.