I can see it now: "Turn right after passing the building that was torn down 5 years ago".

Streetview is not entirely worthless, but it's hardly something to rely on either.