> Exchanging numbers is speech.

Fraud isn't protected speech. Even if you use speech in the course of comitting it. The issue here is securities fraud, not prohibiting the exchange of bitcoins.