search

Lightning-AI / litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
https://lightning.ai
Apache License 2.0
6.85k stars 726 forks source link

Add support for phi-3-mini #1345

Closed Dev-Khant closed 3 weeks ago

Dev-Khant commented 3 weeks ago

Phi-3-mini is now available on HF.

phi-3-mini-4k-instruct: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct phi-3-mini-128k-instruct: https://huggingface.co/microsoft/Phi-3-mini-128k-instruct

Dev-Khant commented 3 weeks ago

@rasbt @Andrei-Aksionov Do we need this? If yes then can I work on it :)

Dev-Khant commented 3 weeks ago

Already there's a PR: #1341. So closing it.