gimseng / 99-ML-Learning-Projects

A list of 99 machine learning projects for anyone interested to learn from coding and building projects
MIT License
574 stars 173 forks source link

[EXE] Transfer Learn From BERT for Text Classification #180

Open BrianTshatiwa-zz opened 2 years ago

BrianTshatiwa-zz commented 2 years ago

Learning Goals

I want to contribute code on how to transfer learn from BERT for text classification

Exercise Statement

Transferring embeddings from BERT to a feed-forward neural network for text classification

Prerequisites

Knowledge on text classification, tensorflow and sklearn

Data source/summary:

Will implement the model on disaster tweets dataset Dataset name: DisasterTweets(https://www.kaggle.com/vstepanenko/disaster-tweets)

(Optional) Suggest/Propose Solutions

I have the solution using tensorflow, will be happy to create pull request to include the exercise statement/solution