Packaging modules as single package with extra (data-prep-kit[ray,spark] and data-prep-kit-tranforms[all, ray, etc.])

IBM / data-prep-kit

Open source project for data preparation of LLM application builders

https://ibm.github.io/data-prep-kit/

Apache License 2.0

320 stars 135 forks source link

Packaging modules as single package with extra (data-prep-kit[ray,spark] and data-prep-kit-tranforms[all, ray, etc.]) #674

Closed touma-I closed 1 month ago

touma-I commented 1 month ago

Why are these changes needed?

In this release, we create a single pypi package for data-prep-kit[dev,ray,spark] and a single data-prep-kit-transforms[all,ray,code_quality,doc_id,etc]

Related issue number (if any).

https://github.com/IBM/data-prep-kit/issues/673