raphaelsty / neural-cherche

Neural Search
https://raphaelsty.github.io/neural-cherche/
MIT License
346 stars 17 forks source link

What is licence of the splade/sparsembed models hosted in huggingface? #10

Closed seganrasan closed 9 months ago

seganrasan commented 10 months ago

Hi @raphaelsty, could you please let me know what is the licence of the below splade/sparsembed models hosted in huggingface?

https://huggingface.co/raphaelsty/splade-max https://huggingface.co/raphaelsty/distilbert-splade https://huggingface.co/raphaelsty/sparsembed-max https://huggingface.co/raphaelsty/distilbert-sparsembed

raphaelsty commented 10 months ago

Sparsembed models are fully open-source.

I'm not sure for Splade since the original work is not open-source. I did create the code from scratch and did not reuse any code or weights from the authors. On my side I put an MIT License on the repository. So I don't know if authors license apply or not to the specific Splade model.

These models on HuggingFace come from a previous version of the lib without any prefix in the query nor the documents [Q] and [D]. You may want to fine-tune a new model on msmarco in order construct a better model.

seganrasan commented 10 months ago

thanks @raphaelsty, this really helps.

skeptrunedev commented 10 months ago

I had the exact same question, it might be a good idea to put that in the README

seganrasan commented 10 months ago

+1. @raphaelsty, It would be great if you update the licence info in the huggingface page especially for

https://huggingface.co/raphaelsty/sparsembed-max https://huggingface.co/raphaelsty/splade-max

raphaelsty commented 10 months ago

@seganrasan SparseEmbed is open-source,

I don't know about splade-max which I think is non-commercial only even if I wrote a brand new code and train a model with my code code.

seganrasan commented 9 months ago

Thanks @raphaelsty. It would be really helpful if you update the licence details of SparseEmbed model in the huggingface page. https://huggingface.co/raphaelsty/sparsembed-max

raphaelsty commented 9 months ago

Updated the Readme and the HuggingFace models checkpoints

seganrasan commented 9 months ago

thanks @raphaelsty