IBM / data-prep-kit

Open source project for data preparation of LLM application builders
https://ibm.github.io/data-prep-kit/
Apache License 2.0
137 stars 105 forks source link

[Feature] Publish Single Wheel for Doc Quality Transform #533

Open touma-I opened 3 weeks ago

touma-I commented 3 weeks ago

Search before asking

Component

Transforms/Other

Feature

DataSift need need to use doc_quality transform

Are you willing to submit a PR?

touma-I commented 3 weeks ago

set DPK_VERSION_SUFFIX= .dev2 (matches latest published version of the library that excludes test). Modify transform pyproject to have dependency on "data-prep-toolkit==0.2.1.dev2", Also, change package_dir=[src] (exclude test)

make set-versions
make build-list
make publish-list