I think only if there's a direct threat of violence. It could be argued that a swastika on a synagogue is a threat of violence but it'd be on a case by case basis for those edge cases. A kid doing it for giggles is different to a violent gang doing it