search

IBM / data-prep-kit

Open source project for data preparation of LLM application builders
https://ibm.github.io/data-prep-kit/
Apache License 2.0
320 stars 135 forks source link

Add KFP to the new html2parquet and HAP transforms #690

Closed shahrokhDaijavad closed 1 month ago

shahrokhDaijavad commented 1 month ago

Search before asking

Component

KFP workflows

Feature

Two new transforms need to have the KFP pipeline added. 1) html2parquet: https://github.com/IBM/data-prep-kit/pull/666 which has been merged 2) HAP: https://github.com/IBM/data-prep-kit/pull/685 This one (the Ray version) is still under review and has not been merged yet. It will be merged in a few days.

Are you willing to submit a PR?

shahrokhDaijavad commented 1 month ago

Thank you, @revit13 and @roytman. Nice job in such a short time!