search

facebookresearch / LAMA

LAnguage Model Analysis
Other
1.36k stars 184 forks source link

Running setup.py install for fastBPE ... error #36

Closed mathieugrasland closed 4 years ago

mathieugrasland commented 4 years ago

It seems that I struggle with the requirements step ; fastBPE and fairseq are the last 2 module to installed and I run into a problem :

image

How to fix that ?

Thank you for your time,

Mathieu

mathieugrasland commented 4 years ago

I am on WIN10, I created a conda env only for lama, this errors appears with using pip install -r requirements.txt I have seen that maybe fastBPE isn't compatible with Windows, any windows users here? If you are not a Windows user, maybe you have a clue?

fabiopetroni commented 4 years ago

If you are only interested in using BERT, you can avoid installing BPE and fairseq

On Mon, 1 Jun 2020, 13:47 Mathieu Grasland, notifications@github.com wrote:

I am on WIN10, I created a conda env only for lama, this errors appears with using pip install -r requirements.txt I have seen that maybe fastBPE isn't compatible with Windows, any windows users here? If you are not a Windows user, maybe you have a clue?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/facebookresearch/LAMA/issues/36#issuecomment-636841370, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADB46UE6LWFE35YQ2R2EAELRUOPN5ANCNFSM4NPGWOFA .

mathieugrasland commented 4 years ago

Hi @fabiopetroni thank you for your anwser,

So I removed the fairseq requirement in the .txt The setup works, but then when I try to do : python lama/eval_generation.py --lm "bert" --t "The theory of relativity was developed by [MASK] ." image

It seems that fairseq is needed...

fabiopetroni commented 4 years ago

Comment out everything inside roberta connector + all other connectors with issues. If you are exclusively interested in BERT.

On Mon, 1 Jun 2020, 18:26 Mathieu Grasland, notifications@github.com wrote:

Hi @fabiopetroni https://github.com/fabiopetroni thank you for your anwser,

So I removed the fairseq requirement in the .txt The setup works, but then when I try to do : python lama/eval_generation.py --lm "bert" --t "The theory of relativity was developed by [MASK] ." [image: image] https://user-images.githubusercontent.com/54704295/83436110-9cde5c00-a43d-11ea-8432-aa67c7ddaa1d.png

It seems that fairseq is needed...

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/facebookresearch/LAMA/issues/36#issuecomment-637000171, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADB46UDQ7E3ZY4N3YASSKVDRUPQCTANCNFSM4NPGWOFA .

fabiopetroni commented 4 years ago

@mathieugrasland to clarify, you need to comment out all the code in this file (or simply delete it) without deleting the file. https://github.com/facebookresearch/LAMA/blob/master/lama/modules/roberta_connector.py

You need to do the same for all others problematic files. I hope BERT is not among those.

mathieugrasland commented 4 years ago

I just tried...and it works! I had to modify the init python file and comment everything linked to roberta! So much thanks!