huggingface / disaggregators

🤗 Disaggregators: Curated data labelers for in-depth analysis.
Apache License 2.0
66 stars 3 forks source link

Allow Disaggregator to receive custom modules #20

Closed NimaBoscarino closed 1 year ago

NimaBoscarino commented 1 year ago

Closes #9, by allowing the Disaggregator to receive custom modules. These modules have to be created by subclassing the CustomDisaggregator, which provides a simpler interface for creating custom modules. The intention is to try to keep that interface more stable and "public-friendly" than the DisaggregationModule, which may change more frequently. We'll see how that works out though!

For now, custom modules can only be created by subclassing and not programmatically, but I can revisit adding that option if there is interest.