Maybe this has improved, but a few months ago, OpenAI p99 latency was much worse than a self hosted solution, which would be a problem in certain cases.