Additional scripts for text classification

kermitt2 / delft

a Deep Learning Framework for Text https://delft.readthedocs.io/

Apache License 2.0

387 stars 64 forks source link

Additional scripts for text classification #149

Closed lfoppiano closed 9 months ago

lfoppiano commented 1 year ago

This PR (still WIP) adds an general application for text classification to quickly read a CSV or TSV to build a model for classification. In addition I've added dtype=object to the arrays that improved the memory management when dealing with large input files.