Using DuckDb as a SQL data source for Perspective

[stevesimmons]

Has anyone tried DuckDb as a data source to drive Perspective?
That could give simple Parquet input and SQL querying, with Arrow output into the Perspective grid.

Another potentially useful package here is node-duckdb, a TypeScript DuckDb implementation.

Thanks!

[texodus]

Sorry about the late reply @stevesimmons

It is pretty trivial to build an app that uses DuckDB's Arrow writing support to generate data suitable to be consumed by Perspective, in Browser/Wasm, Node or Python. You'd need to be careful what queries you generate, as Perspective cannot currently read all Arrow types.

However, Perspective is basically already a SQL engine for streaming queries, it just doesn't use SQL-the-language for queries (yet). DuckDB has some really nice static features itself, but I am skeptical the right solution to bridge the feature gap is to string these two query engines together end-to-end, at least as far as providing a coherent UX is concerned.

<perspective-viewer> is very tightly coupled to its wasm data engine, and replacing this outright with DuckDB or anything else is out-of-scope for the project as it stands today.