pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
https://pathway.com
Other
2.84k stars 98 forks source link

Make external dependencies optional #16

Open ilyanoskov opened 3 months ago

ilyanoskov commented 3 months ago

Hello, do you think it's possible to make some of the external dependencies optional for Pathway?

Things like:

or anything else that the end users might not actually need to run Pathway? In my personal case, I never intend to use google-api or Office365 and I don't want to bring these dependencies in my Python project. I think it makes sense if these become optional / installable separately?

dxtrous commented 3 months ago

Thanks for bringing this up. Providing package extras that would allow e.g. pip install pathway[no-xpacks] with a minimum set of dependencies is on the roadmap. Keeping this one open until it happens.