dsp-uga / andromeda

This repository contains a Naive Bayes classifier implemented on document classification which is completed on CSCI 8360, Data Science Practicum at the University of Georgia, Spring 2018.
MIT License
4 stars 1 forks source link

[GCP] ImportError: No module named nltk.stem.wordnet #35

Closed nihalsoans91 closed 6 years ago

nihalsoans91 commented 6 years ago

The error occurs only on GCP even though nltk is there .

nihalsoans91 commented 6 years ago

Tried going to python shell and importing nltk.stem.wordnet and it works

nihalsoans91 commented 6 years ago

tried going into the pyspark shell and importing nltk.stem.wordnet and it works

nihalsoans91 commented 6 years ago

My only doubt is that the pyspark is spooling out of my environment , will try shh into each worker and try

nihalsoans91 commented 6 years ago
  1. Installed pip using sudo apt-get install python-pip
  2. Imported nltk on workers pip install nltk

Worked