search

IBM / data-prep-kit

Open source project for data preparation of LLM application builders
https://ibm.github.io/data-prep-kit/
Apache License 2.0
47 stars 22 forks source link

Remove requirements.txt from filter and doc_id spark transforms #357

Closed daw3rd closed 1 week ago

daw3rd commented 1 week ago

Why are these changes needed?

To enable publishing of spark doc_id and filtering transforms.

Related issue number (if any).

Fixes issue #356