ml-explore / mlx-examples

Examples in the MLX framework
MIT License
6.29k stars 897 forks source link

[FEATURE REQUEST] Support for LLM2VEC Encoder-Decoder LLMs #1052

Open HydrogenBombaklot opened 1 month ago

HydrogenBombaklot commented 1 month ago

I would like to request support for LLM2VEC, which turns Decoder-only LLM's into bidirectional Encoder-Decoder models.

https://github.com/McGill-NLP/llm2vec