infiniflow / infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text
https://infiniflow.org
Apache License 2.0
2.68k stars 275 forks source link

Update PhysicalImport::ImportPARQUET #2282

Closed yangzq50 closed 1 day ago

yangzq50 commented 1 day ago

What problem does this PR solve?

Import parquet file in batches Reduce memory cost

Type of change