Various legal systems have varying definitions of what is and is not a legal infringement on property rights.
For instance, in (some parts of?) the UK there's the Right to Roam, I believe, which grants the public limited rights to pass through certain private property (such as an open field). Obviously this doesn't extend to harming anything. The point is, passing through someone's private property without causing any damage or inconveniencing them is not automatically considered unethical.
For the record, freedom to roam in England and Wales is rather limited in scope; the quintessential right-to-roam countries are the Nordics (and to an extent Scotland, but it’s an honorary Nordic country anyway). For example, in Finland the customary rights extend beyond just hiking to activities like gathering wild berries and mushrooms.
For instance, in (some parts of?) the UK there's the Right to Roam, I believe, which grants the public limited rights to pass through certain private property (such as an open field). Obviously this doesn't extend to harming anything. The point is, passing through someone's private property without causing any damage or inconveniencing them is not automatically considered unethical.