argilla-io / argilla-plugins

🔌 Open-source plugins for with practical features for Argilla using listeners.
Apache License 2.0
6 stars 2 forks source link

directional sync `datasets` A->B #3

Open davidberenstein1957 opened 1 year ago

davidberenstein1957 commented 1 year ago

Sometimes, all incoming data need to be used for two different labelling tasks. It might be nice define this in an abstract manner.

MVP

from argilla_plugins.datasets import directional_sync

directional_sync(name_from="dataset_from", name_to="dataset_to")
directional_sync.start()

Stretch filtering variables like query or sample could be added to limit the sync. Consider workspace specific sync.