As long as they don’t plan to demolish Earth to make way for an intergalactic highway (a reference to The Hitchhiker’s Guide to the Galaxy), we’re fine. Humans are not out to get ants, but imagine how many ant colonies we have destroyed to build our highways. Indifference does not preclude a threat.