Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
almostnormal
on Dec 12, 2022
|
parent
|
context
|
favorite
| on:
Ask HN: Someone is proxy-mirroring my website, can...
If direct (non proxied) access from the search engine spiders can be identified serve the real robots.txt. Otherwise disable crawling. Also, switch meta noindex like this.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: