pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
https://pathway.com
Other
2.84k stars 98 forks source link

Download files in parallel in gdrive connector #58

Open KamilPiechowiak opened 1 month ago

KamilPiechowiak commented 1 month ago

Is your feature request related to a problem? Please describe. GDrive connector downloads files sequentially (new download starts when a previous finishes). It makes reading from gdrive slow.

Describe the solution you'd like GDrive starting to download multiple files at once.