IBM / data-prep-kit

Open source project for data preparation of LLM application builders
https://ibm.github.io/data-prep-kit/
Apache License 2.0
47 stars 22 forks source link

remove globals in ray transforms that should insteads be references to the python transform globals #336

Closed daw3rd closed 1 week ago

daw3rd commented 1 week ago

Some ray transforms, that are based on a pure python implementation, were redefining constants such as short_name, cli parameters, and config keys. They were copies of the definitions in the python transform file.

Why are these changes needed?

It was redundant, misleading and prone to future errors.

Related issue number (if any).