IBM / unitxt

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
https://www.unitxt.ai
Apache License 2.0
161 stars 45 forks source link

Need a way to rename and deprecate artifacts #1341

Open yoavkatz opened 2 weeks ago

yoavkatz commented 2 weeks ago

The catalog today has some wrongly named artifacts in the wrong local. We need a backward compatible way to migrate to it.

1) Add deprecation string field to each artificat. If set to anything but 'None', a message will be printed when loading the artifact:

"Artifact XXXX was loaded from catalog but is deprecated: {deprecation}. "

The catalog UX should highlight that they are deprecated (e.g. red flag)

2)We would have a way to link an artifact to another artifact.

artifact = ArtifactReference(reference="tasks.my_task" ) add_to_catalog(artifact,"tasks.my_old_task")

This will make loading "tasks.my_old_task" return the "Task.my_task")