chdb-io / chdb

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse
https://clickhouse.com/chdb
Apache License 2.0
2.13k stars 75 forks source link

Data input hooks (WIP) #130

Closed lmangani closed 11 months ago

lmangani commented 1 year ago

Work in progress for tracking and comments only

Changelog category:

Changelog entry

Optional handlers for --input_format and data input --file

lmangani commented 1 year ago

@auxten @laodouya perhaps --file could be attached to a FIFO named pipe? This way whatever the python app pushes to the FIFO ahead of execution could be processed by the query.

The desired effect being able to do the following directly from python code

# python3 -m chdb "SELECT 1", "Native" > output.native
# python3 -m chdb "SELECT * FROM table" < output.native
1 
CLAassistant commented 11 months ago

CLA assistant check
All committers have signed the CLA.