You'd never want to restrict who'd live there overtly. But you could do it by more subtle means, like giving pedestrians and bicycles priority over cars, and mixing inexpensive buildings with expensive ones.