lightonai / pylate

Late Interaction Models Training & Retrieval

https://lightonai.github.io/pylate/

MIT License

158 stars 7 forks source link

Stanford loading using bin file #69

Open NohTow opened 1 week ago

NohTow commented 1 week ago

68 fixed the local loading of Stanford models, but the issue is that the safe tensor is only created when uploaded to HF through the dedicated bot.

This PR changes the loading logic to rely on the pytorch_model.bin file that is always there both locally and remotely. cc @jessiejuachon

NohTow commented 1 week ago

Tests failing are not related to the PR but to this. We should either wait for ST to create the version with the merged fixes or set the version of transformers to pre-4.46.