Switch to differentiable head, larger input sequence

huggingface / setfit

Efficient few-shot learning with Sentence Transformers

https://hf.co/docs/setfit

Apache License 2.0

2.24k stars 223 forks source link

Switch to differentiable head, larger input sequence #489

Closed danielkorat closed 7 months ago

danielkorat commented 9 months ago

Change the model head to SetFitHead t alleviate throughput bottleneck
Add instructions for installing TCMALLOC (required)
More robust benchmarking using random sequences of length 256

@tomaarsen

review-notebook-app[bot] commented 9 months ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

HuggingFaceDocBuilderDev commented 9 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

danielkorat commented 9 months ago

Thanks :)

@MosheWasserb, should we merge the notebook or wait for the blog release?