11-10-2023 / need to create text classification techniques

[khinkhantkhanthlaing]

We need to create some text classification techniques.

[eainthmone231]

Here in this commit b3d69eec9565095cd8034bd3c3e16c54a29f782f I upload binary text classification experiment using Bert as feature extraction and lightgbm as classifier with Hugging face library. I used Bert for the reason to personally test the architecture and used lightgbm to train the model faster. We can use different approaches to get better accuracy by using pooler outputs or by concatenating last hidden layers of Bert according to this research articles BERT-word-embeddings-tutorial. If you are interested in it , I would like to suggest to try.