search

premAI-io / state-of-open-source-ai

:closed_book: Clarity in the current fast-paced mess of Open Source innovation
https://book.premai.io/state-of-open-source-ai
Other
1.52k stars 89 forks source link

Adding Parameter efficient Fine-tuning techniques for LLM #102

Open Anindyadeep opened 11 months ago

Anindyadeep commented 11 months ago

Type

new chapter

Chapter/Page

fine-tuning

Description

The contents on this chapter should be the following:

  1. What is Parameter efficient fine-tuning methods and why we do it.
  2. Different PEFT methods: a. Prompt Tuning b. LoRA c. QLoRA etc