weso-edma / hercules-challenge-publications

Code related to the Researchers and Publications track from the Hercules challenge
GNU General Public License v3.0
0 stars 2 forks source link

Fix pickle imports of text preprocessor #14

Closed alejgh closed 4 years ago

alejgh commented 4 years ago

When importing the final pipeline an error is raised saying that the Spacy nlp vectors used to preprocess the texts can't be found. Manually importing the dependencies of the TextPreprocessor and loading the nlp model fixes this, but is not very practical. We should find a fix for this error.

I think that moving the TextPreprocessor class to its own Python module will fix the issue, but if this is not the case we will need to look into the pickle and dill modules for further help.