Create huggingface version of text classification relevance task

os-climate / aicoe-osc-demo

This repository is the central location for the demos the ET data science team is developing within the OS-Climate project. This demo shows how to use the tools provided by Open Data Hub (ODH) running on the Operate First cluster to perform ETL, create training and inference pipelines.

Apache License 2.0

11 stars 24 forks source link

Create huggingface version of text classification relevance task #221

Closed Shreyanand closed 1 year ago

Shreyanand commented 1 year ago

In order to integrate better with the sparsified models, it would be easier to write models using the transformer package.

Acceptance:

[ ] Add a training and inference notebook for relevance task using transformer package