naver / splade

SPLADE: sparse neural search (SIGIR21, SIGIR22)
Other
710 stars 79 forks source link

Dockerized environment to run splade #27

Closed shikharsrivastava closed 1 year ago

shikharsrivastava commented 1 year ago

Can you please provide a Dockerfile to run splade? The conda env has dependencies on binaries built against nvidia-cuda for linux platform. I cannot build it for non-cuda linux and osx. I tried replacing those dependencies with their replacement built for usage with cpu, however, still did not manage to make it work.

A Dockerfile should allow users to use splade more easily across platforms.

cadurosar commented 1 year ago

Hi @shikharsrivastava sorry for the delay on answering this, but the main problem for us is a technical one: No one on the team is actually familiar with working with docker. Maybe someone in the community could help getting this out?

KevinColemanInc commented 1 year ago

+1, I have spent a few hours trying to run this on my m1 arm macos mac. Still haven't got it to work yet

I am struggling to get this to run on colab too

KevinColemanInc commented 1 year ago

I got the python notebook working on my m1.

For future people: Remove the following from conda_spade_env.yml

Bump the version

Add the pip packages the env

Add the dependency

For @cadurosar, would you be open to an MR to update the readme and include an m1 friendly conda env?

cadurosar commented 1 year ago

For sure, this would also help me test on my machine.

thibault-formal commented 1 year ago

hi @shikharsrivastava , as Carlos said, we are not very familiar with docker. If you feel comfortable, feel free to submit a PR. closing the issue for the moment