Closed pjuangph closed 1 year ago
I looked through all your code and was unable to find the class PropertyTokenizerSquare. This is referenced by run_lm_nlp.py
PropertyTokenizerSquare
run_lm_nlp.py
Hi @pjuangph, Thanks for your interest. This class is available in terminator.tokenization from the main branch, see here.
terminator.tokenization
main
Hope this helps! Let us know if you need further advice
I looked through all your code and was unable to find the class
PropertyTokenizerSquare
. This is referenced byrun_lm_nlp.py