IBM / low-resource-text-classification-framework

Research framework for low resource text classification that allows the user to experiment with classification models and active learning strategies on a large number of sentence classification datasets, and to simulate real-world scenarios. The framework is easily expandable to new classification models, active learning strategies and datasets.
Apache License 2.0
97 stars 20 forks source link

Reorder operations for better memory usage with CLS inference #3

Closed jysdoran closed 3 years ago

jysdoran commented 3 years ago

I ran into more GPU memory errors while trying to use CLS inference. Only storing the relevant positions helps again.