it could be an open source project, i'd be interested | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

alecco on March 30, 2012 | parent | context | favorite | on: DuckDuckGo is blowing up

it could be an open source project, i'd be interested

TomAnthony on March 31, 2012 [–]

You could start by playing around with this data: http://commoncrawl.org/

The ways you can interact with it currently are limited, but I think that'll improve.

alecco on March 31, 2012 | [–]

That project looks amazing. But it'd be nicer to have some sort of compressed raw dump to use different tools.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact