search

epfml / sent2vec

General purpose unsupervised sentence representations
Other
1.19k stars 256 forks source link

model.load() is stuck #69

Closed parmeshashwath closed 5 years ago

parmeshashwath commented 5 years ago

When trying to the load the torontobooks_unigrams.bin the process is stuck and the loading is not getting completed from a long time. Is there any other config that needs to be done before loading. Code Snippet Used

import sent2vec model = sent2vec.Sent2vecModel() model.load_model(torontobooks_unigrams.bin')

mpagli commented 5 years ago

which OS are you on?

parmeshashwath commented 5 years ago

OS: Red Hat Enterprise Linux Server release 7.4 (Maipo) Below is the available memory in GB total used free shared buff/cache available Mem: 377 31 10 3 335 336 Swap: 31 0 31

mpagli commented 5 years ago

Did you try to use the shared memory parameter? model.load_model('model.bin', inference_mode=True)

parmeshashwath commented 5 years ago

Yes , Tried with Shared memory parameter as well. But still no luck. The machine has a good amount of memory, not sure what is the issue here

Regards, Parmesh A +91 9731354958

On Thu, Apr 4, 2019 at 4:13 PM mpagli notifications@github.com wrote:

Did you try to use the shared memory parameter? model.load_model('model.bin', inference_mode=True)

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/epfml/sent2vec/issues/69#issuecomment-479846403, or mute the thread https://github.com/notifications/unsubscribe-auth/AKjscTZl3IfRejyjfYWxQxE90MDVbGdMks5vddc8gaJpZM4cacrz .

mpagli commented 5 years ago

Ok, I found the reason, will fix soon

parmeshashwath commented 5 years ago

Great Thanks for the update. Please let me know once you fix it. Thanks again

mpagli commented 5 years ago

Can you pull the latest code and try again?

parmeshashwath commented 5 years ago

Yes tried and it's still the same :(. Model is not loading. any other workarounds?

mpagli commented 5 years ago

You did 'pip install . --upgrade'?

parmeshashwath commented 5 years ago

Thanks this worked. Able to get the sentence embeddings.