tira-io / ir-experiment-platform

27 stars 3 forks source link

question about modifying the model #6

Open Lim-Sung-Jun opened 11 months ago

Lim-Sung-Jun commented 11 months ago

hello

how can i use the pipeline with modified colbert?

where can i find colbert code? do i have to git clone the colbert code into directory?

i want to check the performance with modified colbert

thank you!

mam10eks commented 11 months ago

Hi!

The colbert code is the original PyTerrier colbert code, that we use here out-of-the-box without modification using this model.

If you want to switch out the model, you would have to rebuild the docker image with this command (please execute this command from this directory):

docker build -t webis/tira-ir-starter-pyterrier-colbert:0.0.2 --build-arg MODEL_NAME=http://www.dcs.gla.ac.uk/~craigm/colbert.dnn.zip -f pyterrier-colbert/Dockerfile .

Where MODEL_NAME points to the model. After the Docker image was build with the command above, you can test it via this command:

tira-run \
    --input-directory ${PWD}/sample-input \
    --image webis/tira-ir-starter-pyterrier-colbert:0.0.2 \
    --command '/reranking.py --input $inputDataset --output $outputDir'

Does this answer your question?

Best regards,

Maik