> Why didn't Elon start SpaceX in Canada or South Africa?

Exactly my point. If you want to start a company as ambitious as SpaceX, the US is the only place to do it. If you do it somewhere else, you incur serious risk of getting a large chunk of the company seized/taxed, even if you are successful.