Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Obviously these bots don't obey the crawling directives today, why would they change in the future?


Hey! From the Dappier team here, the team quoted in this piece.

In our opinion, the industry's brand new! The fact that everyone is still visiting websites & turning to Google for info is a sign of that.

Companies like Google are incentivized to figure this out: they risk killing their ads business by building up their own AI scraping product w/ Gemini & AI search.

All sorts of publishers & content owners have started to explore their legal options or launch lawsuits. We're building to provide a fair & realistic alternative!

If you're interested, please take a look at dappier.com, try building an AI agent & add a data set & let us know if you have any feedback. :) Right now we support AirTable & RSS integrations!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: