There is an example[1] on their official site of an Australian living abroad in Japan and being a "resident for tax purposes" and thus being taxed, but not being a resident for other purposes.
As far as I know, in most countries, acquiring permanent residence requires living in the country for years first and then applying, so you will be on time-limited visas until then. That is the way it is in Japan, and it is 10 years to get PR, in the general case.
Anyway, I'm not an expert on Australian tax law by any means, I just wanted to note that it's not always so clear cut as "do other countries tax citizens living abroad".
This confusion is common amongst people who haven't lived in abroad. Visa status, work permits, future intentions, work contracts and citizenships are all separate things and most countries weigh more than one factor to determine tax-residency.
In this example, the operative bit is this:
> She has a one-year contract, after which she plans to tour China, [...]
This time-boxes her intentions for living abroad. It's distinct from having an unlimited work contract with a temporary visa that requires renewals, which indicates intent to stay abroad (and potentially a basis for the visa renewals).
Other countries use things like a point system (UK), definitions of "centre of life" (Russia, where I live atm) and so on. Either way, Australia doesn't do the thing that the US & Eritrea do (tax applicability solely based on citizenship).
> As far as I know, in most countries, acquiring permanent residence requires living in the country for years first and then applying, so you will be on time-limited visas until then.
I joined a US-based Company who organized my Green Card without me having ever been there.
As long as your intention is to migrate to a different country you're regarded as a non-resident in which case you wont have to pay taxes on worldwide income, unlike in the US.
[1]: https://www.ato.gov.au/Individuals/coming-to-australia-or-go...