Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Because most data isn't "big" data. If it fits in Excel on a laptop, why bother to roll out a distributed data lake system like Spark with all the associated ops work.


... and if it doesn't fit on Excel on a laptop, the natural path is just some database running on a desktop, then a server, then a beefier server. It's actually amazing how far just something like postgres will scale for your data needs.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: