Improvements to MLM script

seyonechithrananda / bert-loves-chemistry

bert-loves-chemistry: a repository of HuggingFace models applied on chemical SMILES data for drug design, chemical modelling, etc.

MIT License

389 stars 60 forks source link

Closed gabegrand closed 3 years ago

gabegrand commented 3 years ago

Added an eval split with configurable frac_train
Added more flags to customize logging and eval frequency
Reduced default vocab_size to 600, which is a bit larger than the vocab in seyonec/SMILES_tokenized_PubChem_shard00_160k
Added a flag to turn off mixed-precision since it was giving me some errors