This is sometimes true, but the way you phrase things, your body language, etc. can make a difference.

There's a great book called You and the Police by Boston T. Party that goes into depth on that.