I've got a dumb Fitbit Charge. It already have shown me why would I want Apple watch: first, the incoming call notification is unexpectedly useful. Second, I already want the better activity tracking available on Apple Watch.
And yes, taking phone out of the pocket (or purse) is indeed inconvenience.