Code here: https://github.com/google/robotstxt | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rasmi on July 1, 2019 \| parent \| context \| favorite \| on: Google’s robots.txt parser is now open source Code here: https://github.com/google/robotstxt

glenneroo on July 1, 2019 [–]

It's also the 5th link "open sourced" in the article.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact