aneesh-joshi / LSTM_POS_Tagger

A simple POS Tagger made using a Bidirectional LSTM using keras trained on the Brown Corpus
34 stars 19 forks source link

Refactoring Log #16

Open aneesh-joshi opened 5 years ago

aneesh-joshi commented 5 years ago

Here are my plans for a major refactoring. Since I last wrote the repo, I have learned a lot more design patterns and best practices which I want to incorporate here.

  1. Make everything a class/object (currently everything runs a standalone script)
  2. Remove dependencies on saved pickles. While it is good to be able to save it, pickle can be unreliable and I unnecessarily slows down the processing.
  3. Adding gensim-data support. Downloading glove vectors and the brown corpus can be tedious. All this is done by gensim-data and can be used out of the box.
  4. More accessible for cross checking
aneesh-joshi commented 5 years ago

@rachitjain2706 Please refer to this. Keep discussions for refactoring here.