search

oborchers / Fast_Sentence_Embeddings

Compute Sentence Embeddings Fast!
GNU General Public License v3.0
616 stars 83 forks source link

Reduce Model Size for Inference #26

Closed fros1y closed 4 years ago

fros1y commented 4 years ago

Is it possible to reduce model size by discarding previously calculated sentence vectors? This would be for downstream inference-only uses.

Best,

oborchers commented 4 years ago

Hi! That is actually a nice feature! Yes, you should be able to replace the model.sv.vectors by a null vector and it should work fine.