danielwatson6 / hate-speech-project

6 stars 1 forks source link

RaggedTensor punctuation and lowercasing method #18

Closed danielwatson6 closed 4 years ago

danielwatson6 commented 4 years ago

To improve flexibility with experiments (checking if punctuation and lowercasing helps), these should be added as hyperparameters to data loaders.

Since the logic is common, a method that implements this on ragged tensors should be implemented in data_loaders/utils.py