You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I'm really impressed by Arquero and the use of the Arrow format.
I'm trying to use ClickHouse database (which is really fast) with Arquero using Arrow format, since ClickHouse can return the output in different formats including Arrow, and I can send the sql query to their http endpoint using fetch, such as:
data_promise = aq.loadArrow('http://myserver:8123/?add_http_cors_header=1&user=default&password=&default_format=Arrow',
{ fetch: { method: 'POST', body: 'SELECT col_A, count(*) as cnt from mytable group by col_A' }});
The problem is that strings are returned as binary type and Arquero does not recognize them as strings, so I need to use "derive" on every string column to decode them.
I know the problem is that ClickHouse is not returning the type correctly but I think Arquero and ClickHouse make such a great match that it would be worth it to make it possible to load Arrow tables and convert binary types to strings automatically.
Thank you.
The text was updated successfully, but these errors were encountered:
Hi,
I'm really impressed by Arquero and the use of the Arrow format.
I'm trying to use ClickHouse database (which is really fast) with Arquero using Arrow format, since ClickHouse can return the output in different formats including Arrow, and I can send the sql query to their http endpoint using fetch, such as:
The problem is that strings are returned as binary type and Arquero does not recognize them as strings, so I need to use "derive" on every string column to decode them.
I know the problem is that ClickHouse is not returning the type correctly but I think Arquero and ClickHouse make such a great match that it would be worth it to make it possible to load Arrow tables and convert binary types to strings automatically.
Thank you.
The text was updated successfully, but these errors were encountered: