Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Building more Amazon scraper websites. Working on a framework to minimize the effort of creating them, and currently testing to see if I can automate most of the process with Anthropic’s Sonnet.

The most recent site is https://computerdisplayprices.com

When I’m done, I’m probably going to make a blog post or two just talking through the automation I figured out so far. LLMs are amazing force multipliers.



what toolset do you use for scraping? puppeteer?


Nope, just selenium and pyautogui. The priority is to fly under the radar, rather than efficiency; for that I needed lower-level control. There's a bunch of other stuff I did to improve the anonymity, but to download I just open selenium at the url, wait for it to load, then use pyautogui to type 'ctrl-s' and type in the save directory.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: