Read model weights - Githubissues

huggingface / swift-transformers

Swift Package to implement a transformers-like API in Swift

Apache License 2.0

536 stars 46 forks source link

Open shavit opened 2 months ago

shavit commented 2 months ago

Read model weights from safetensors.

shavit commented 2 months ago

Weights are now accessible independently of configurations for flexibility and without MLModel or conversion.

pcuenca commented 2 months ago

That's very cool @shavit! May I ask what use case you have in mind for this?

Edit: Oh, I see it's for your embeddings work. Any highlights on the general architecture you're considering?

shavit commented 2 months ago

Yes

In the first commit I added weights property to Configurations, but since LanguageModel requires a model, I separated the weights initialization.
- The weights can go into the Embedding module instead, since the language models in this module are tied to CoreML, and don't need this at the moment.
- The Safetensor and others can save updated weights into a file.

The plan is to use models directly from local files or the hub, and maybe support more types like mlx/numpy.