Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Hello, I am using different datacenter IPs first. If all fail to crawl, I have a Raspberry Pi in my house that crawls using my residential IP. ;)

My home IP has not been blocked yet since I regularly do human-like operations from it. Hehe.

But on a serious note, you can try services like Bright Data or Apify that have a ton of residential IPs. So if you see a cloudflare block page, just rotate the proxy.





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: