What I don't fundamentally understand is that ChatGPT even 4 just functions as a better Google.
It seems like there's far more ways for extensive automation by decision making via ChatGPT to cause problems than solve problems. With my experience using it for programming, anything that is non-trivial basically requires you to do it all yourself because ChatGPT will hopelessly get it wrong.
True you can’t just assign it a complex task and expect a perfect result in the first answer but using it like Google e.g. one query and one response is not the best way to use it. It’s a chat bot, it’s been optimized for multi turn conversations so use it that way. Pretend you are messaging someone on slack, discuss the issue with them, explain things, ask for feedback, point out mistakes etc. For more advanced use leverage its initial training as a text completion engine and give it several examples of prompt and response up front or write the first part and ask it to complete the rest.
It seems like there's far more ways for extensive automation by decision making via ChatGPT to cause problems than solve problems. With my experience using it for programming, anything that is non-trivial basically requires you to do it all yourself because ChatGPT will hopelessly get it wrong.