Its a good thing the US is _huge_. I certainly didn't "displace" anybody as I moved back home to Michigan from California to buy a house in the woods. There are at least 6 houses for sale within a half mile from me right now all for well under $300k. People struggling in California could learn a thing or two by moving.
That doesn't stop people from imagining the "Big Bad Californian" in their minds. For a while, I was looking out-of-state for real estate, and I encountered a non-zero number of realtors informing me that their seller intends to charge a "California tax" to anyone coming from that state, because he doesn't like where I'm moving from.
Just because somebody wants to know where you're from, doesn't mean they are entitled to know that. You are under no obligation to say "I'm from California" when buying a house. Your realtor can do all the discussions. "You're a person buying a house".
