Only in the plural form though, right? I'm in the UK, where the usage you describe is common too, but reading "this guy" like in the comment above, I would assume they're talking about a man.
Even then it's highly context-dependent. Ask any heterosexual man "how many guys have you kissed in your life?" and not a single one of them is going to consider this instance of "guys" as encompassing women.
Your understanding is common in the US as well. Singular “guy” would read as “man” or “boy” while the plural “you guys” can read as gender neutral (though some argue that “you guys” should be avoided in mixed gender groups for being inadequately inclusive). I would expect there are some regional US differences in usage and reactions.
