fani-lab / ReQue

A Benchmark Workflow and Dataset Collection for Query Refinement
https://hosseinfani.github.io/ReQue/
Other
0 stars 13 forks source link

Installation and set up the pipeline #1

Closed hosseinfani closed 1 year ago

BhavyaPatel305 commented 1 year ago

Hello, I am using Windows** I was trying to run this command: conda env create -f environment.yml But I guess since I didn't had Anaconda installed, I was getting error But after installing, I am still getting error I tried to look up on internet, on stack overflow they are asking to configure path of anaconda but I am not sure what excatly I should do Can you please help?

hosseinfani commented 1 year ago

@BhavyaPatel305 Can you please send the error you receive here?

BhavyaPatel305 commented 1 year ago

Error But I have already installed Anaconda to my local machine But I guess I need to configure path, which I am not sure

BhavyaPatel305 commented 1 year ago

Also should I send email to Tim Brunet again to remind him or you will send it ?

hosseinfani commented 1 year ago

Error

But I have already installed Anaconda to my local machine

But I guess I need to configure path, which I am not sure

do this in anaconda prompt. it's in the list of tools when you install anaconda

hosseinfani commented 1 year ago

Also should I send email to Tim Brunet again to remind him or you will send it ?

I'll do that

BhavyaPatel305 commented 1 year ago

Yes, that worked.

BhavyaPatel305 commented 1 year ago

Hi, In video you are asking to download anserini and trec_eval but you are not showing how to do it Can you please explain how should I download anserini?

hosseinfani commented 1 year ago

@BhavyaPatel305 I believe you can find it yourself. Follow the links in readme!

BhavyaPatel305 commented 1 year ago

Hi, I have installed Anserini and trec_eval I have indexed anserini using these commands image

So Basically I am at this part of video:

image

But here you are using /data/anserini

For me this command is not working: image

I think this is because I am using Windows may be: Can you tell what mistake I am making? image

hosseinfani commented 1 year ago

@BhavyaPatel305 You don't need to do so as we have the indexes in our internal ms-teams at Query Refinement >> Files >> Indexes. You can start with robust04 for now.

In your command prompt, you have to use correct address. In the video, I said I have the indexes in my server at /data folder. You have to see where you want to put the indexes and put that address.

Please do not blindly follow the instructions :))

BhavyaPatel305 commented 1 year ago

Hello, I was trying to index the files but it is becomming really confusing for me It's like I don't know what do next after this: image

My own pc: image

This part of video: image

I remember that last time you explained me that which file is doing what but I am not getting that how are you getting say for example target folder, like from where did you get that?

I am trying to figure this out since past 3 days

I am really sorry but since this was becomming really confusing I thought I should contact you

Are you available on Monday after DBMS class?

hosseinfani commented 1 year ago

@BhavyaPatel305 Forget about indexes. I asked you to install anserini in its folder. Could you do that?

BhavyaPatel305 commented 1 year ago

Yes, this is what you want right? image

hosseinfani commented 1 year ago

@BhavyaPatel305 this is the source in java. you have to build it. In the bin folder, you should have appassembler folder after.

BhavyaPatel305 commented 1 year ago

Hello, Build was successful image

And now in anserini folder I can see files such as target etc image

But in bin folder I don't see any file as appassembler image

What should I do?

hosseinfani commented 1 year ago

@BhavyaPatel305 Sorry, I meant \target\appassembler\bin

BhavyaPatel305 commented 1 year ago

To get the appassembler folder you need to build it separately image

BhavyaPatel305 commented 1 year ago

@hosseinfani Even after installing the required mingw packages for netbeans to recognise MAKE file

It is still not recognising it image

On google I tried to find something image image

But I don't think that this is helpful in any way.

Do you have any suggestion?

BhavyaPatel305 commented 1 year ago

@hosseinfani Hi, I came to your lab at 2 pm but it was locked

hosseinfani commented 1 year ago

Hi @BhavyaPatel305 , I have no update on this task since Nov. Are you still interested in working in our lab?

BhavyaPatel305 commented 1 year ago

Hi, so after we tried installing some extensions in your office hours you asked me to run make file

But the problem is even after adding extensions, it is still not recognising MAKE file

image

BhavyaPatel305 commented 1 year ago

@hosseinfani Hi, I guess now it works although still it does not recognize MAKE file

but I tried to do this image

Here it gave me error that, there is nothing like pyserini

so I tried to run this command

pip install pyserini

but doing that gives me(Build failed)

image

and then eventually I have to stop it using ctrl + C

So now our main problem is pyserini

I guess then everything should work well

Do you suggest anything?

hosseinfani commented 1 year ago

@BhavyaPatel305 look at their github and the issue pages there. There should be some help: https://github.com/castorini/pyserini

BhavyaPatel305 commented 1 year ago

I found a helpful comment on this, so just posting here just in case if next person needs it

https://github.com/nmslib/nmslib/issues/464

BhavyaPatel305 commented 1 year ago

@hosseinfani Hi, I was thinking that if possible could we just do like where say for example you have 1 copy of this whole program properly set up and running

So what we can do is you can just may be zip it and give it to someone who is installing this software

because I noticed that in the installation process we are just trying to download the files for eval and other folders (just simple file downloads)

But if say you just provide say a zip file where all these files are already downloaded there would be many steps which can be cut up

What do you think?

I am rn stuck at the same problem above

If possible can I meet you tommorrow?

hosseinfani commented 1 year ago

@BhavyaPatel305 in future we can do that, that is, delivering a software bundle. But this is not our priority now. This week I'm very busy but will be in lab most of the time. See you there.

hosseinfani commented 1 year ago

Hi @BhavyaPatel305 Hope you're doing great. It's been a while and there is no update on this task. I think you're busy with courses and cannot find time to work on this project. I understand. For now, we can stop our collaboration until you have lower course work at the school. Hopefully, in future we can continue.

Best, hf