Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yes we do! DuckDB-Wasm can read files using HTTP range requests very similar to the sql.js-httpvfs from phiresky.

The blog post contains a few examples how this can be used, for example, to partially query Parquet files over the network.

E.g. just visit shell.duckdb.org and enter:

select * from 'https://shell.duckdb.org/data/tpch/0_01/parquet/orders.parqu...' limit 10;



NIIIICE! Data twitter was pretty excited about that cool SQLite trick - now you can turn it up a notch!


Is data twitter == #datatwitter, like Econ Twitter is #econtwitter?

If so, I have another cool community to follow!


It would be really cool to load duckdb files too. sql.js-httpvfs seems convenient because it works on everything in database so you don't have to create indexes, or setup keys and constraints in the client.


I agree! DuckDB-Wasm can already open DuckDB database files in the browser the very same way.


That's really neat! Can you control the cache too?


DuckDB-Wasm uses a traditional buffer manager and evicts pages using a combination of FIFO + LRU (to distinguish sequential scans from hot pages like the Parquet metadata).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: