EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
https://www.eleuther.ai/
Apache License 2.0
6.95k stars 1.02k forks source link

Add lora support #1225

Open mkerin opened 6 months ago

mkerin commented 6 months ago

See PROGRESS.md for detailed progress tracking.

In response to #1204