> your passport is tied to your address via your SSN which is tied to tax returns.

Not really. I file my tax return and the address isn't where I live. It doesn't have to be, it's a mailing address.