argilla-io / distilabel

⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.
https://distilabel.argilla.io
Apache License 2.0
1.12k stars 70 forks source link

[FEATURE] Upload pipeline script when pushing distiset to hub #761

Open plaguss opened 5 days ago

plaguss commented 5 days ago

Is your feature request related to a problem? Please describe. I would like to have the pipeline.py file uploaded to the hub automatically like we do with the pipeline.yaml for example, so it's easy to share custom pipelines.

Describe the solution you'd like .

Describe alternatives you've considered Do it by hand.

Additional context .