relatio-nlp / relatio

code base for constructing narrative statements from text
MIT License
98 stars 27 forks source link

Spacy Strip function not called #97

Open CT-P opened 1 year ago

CT-P commented 1 year ago

https://github.com/relatio-nlp/relatio/blob/d686104671adb4f6bf6340228266a1bb7160d5f2/relatio/preprocessing.py#L206

replace by: s=[cleaned_text for token in s if (cleaned_text := token.text.strip()) not in self.stop_words]