Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is cool...Totally reminded me about several tools pop up on HN every now and then in the past for similar task so i did a quick search:

clickhouse-local - https://news.ycombinator.com/item?id=22457767

q - https://news.ycombinator.com/item?id=27423276

textql - https://news.ycombinator.com/item?id=16781294

simpql- https://news.ycombinator.com/item?id=25791207

We need a benchmark i think..;)



I am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources.

dsq CLI - https://github.com/multiprocessio/dsq DataStation desktop app - https://datastation.multiprocess.io/

Two alternative CLI tools that I looked at:

sq - https://sq.io/ octosql - https://github.com/cube2222/octosql

Honourable mentions to:

Miller - https://miller.readthedocs.io/en/latest/index.html Dasel - https://daseldocs.tomwright.me/

These don't use SQL.

VisiData is also amazing for data navigation, although it requires some effort to get the model:

https://www.visidata.org/


xsv is invaluable for processing big csv files: https://github.com/BurntSushi/xsv


qsv is a fork of this, as qsv is pretty much unmaintained now (I don't mean to sound negative, BurntSushi did an AMAZING job and I love the work they did).


Didn't know that. Thanks!


Shameless plug. A desktop app: https://superintendent.app


It looks really nice.

I’ve spend what feels like too much time looking for a windows app that I can use to occasionally preview CSV files before moving them into WSL.

I just think $50/year is too much for occasional use.

Since this posts has initiated several other shameless plugs, maybe I can swoop in and ask for shameless recommendations for something cheap in this space.


Thank you for your kind words. Could you elaborate your use case?

Drop me an email at tanin@ superintendent.app, we should be able to work something out regarding pricing.


we need more shameless plug on this thread ... the more benchmark, the better! I think this would be a fun weekend afternoon :)


Another shameless plug, then: https://www.ultorg.com

This one is another desktop app, with a slightly different approach: in the CSV file case, the data is parsed and dumped into a bundled PostgreSQL database, which you can then query with a visual query interface.


Oh, okay... https://lnav.org is a log file viewer for the terminal that integrates with SQLite so you can use SQL to query your log files.

No benchmarks, though.


I'll save you the trouble, ClickHouse will come up on top by a mile and is the only one listed that supports clustering and spill to disk.


Groupby and joins are a good test. You could also give Duckdb cli api a try (it is column based)


another shameless plug: https://github.com/liquidaty/zsv




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: