> Can you explain why a low-hanging optimization that would reduce costs by 90% without reducing perceived value hasn't been implemented?

Because the industry is running on VC funny-money where there is nothing to be gained by reducing costs.

(A similar feature was included in GPT-5 a couple of weeks ago actually, which probably says something about where we are in the cycle)

Not sure that’s even possible with ChatGPT embedding your chat history in the prompts to try to give more personal answers.

Dunning Krueger