Do you think force should be used whenever someone else's actions affect us negatively?

I agree, there are many things the owner could be doing with his property. I see that as entirely his choice, as long as he is not violating the rights of others.

Could you perhaps try talking to the owner of the vacant lot? Maybe you and he (or her) could find a good solution to the problem you perceive.