If abstaining from something secludes you from your peers, then the abstinence likely would have a larger negative effect.

That said, in college I did go out drinking with friends quite often. Just because that's what everyone did, and it was fun. My best memories are from then.