Open vmehta-cohere opened 5 months ago
It seems like you've got this under control, if you want help or have specific questions, let me know what I can do for you!
I also just encountered this problem and found it very surprising to find out that listeners only work with pre-built template datasets.
From what I could discover it's because /api/datasets
endpoint only returns these pre-built template datasets and deep down listeners only check that endpoint.
This issue is stale because it has been open for 90 days with no activity.
This issue was closed because it has been inactive for 30 days since being marked as stale.
Reopening, as we might still want to tackle this one.
Is your feature request related to a problem? Please describe. For feedback datasets, which carry the ability to carry complex labeling tasks, manual interactions to trigger training/evaluation can be a bottleneck for high frequency models.
Describe the solution you'd like Active listeners for datasets in Argilla to trigger functions on submit, maybe an ability to ex. trigger on submitted 50/60 examples or 60/60 examples etc.