Speech restrictions limit the subject matter if speech, not the sheer volume of speech overall.
You also seem to be conflating the freedom to say what you want with the right to be listened to.