Time, place, and manner restrictions are there to prevent people from doing things in the name of free speech that you can't do anyway, like staying in a campus building after it would normally be closed or protesting in the middle of the street.

Restrictions on political speech in a place and time you can gather with other students to talk about the newest boy band or the unappealing nature of the cafeteria food don't pass constitutional muster for a public institution.