jasonvanf / llama-trl

LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
Apache License 2.0
185 stars 23 forks source link

What's the advantage of this library compare to the official TRL? #7

Open disperaller opened 3 months ago

jasonvanf commented 3 months ago

Perhaps the smallest implementation of TRL, with simple logic.