Open JonathonDunford opened 6 years ago
Force UTF8 encoding on build_tokens.py
Add tokens: CHG, IRC, MIC, MOVI, SLRM, SMELLY, XBV
Force UTF8 encoding on build_tokens.py
Add tokens: CHG, IRC, MIC, MOVI, SLRM, SMELLY, XBV