search

ljvmiranda921 / comments.ljvmiranda921.github.io

Blog comments for my personal blog: ljvmiranda921.github.io
1 stars 0 forks source link

Study notes on parameter-efficient finetuning techniques #52

Open utterances-bot opened 1 year ago

utterances-bot commented 1 year ago

Study notes on parameter-efficient finetuning techniques

Traditional finetuning involves training the parameters of a large language model with a shallower domain-specific network. However, this approach requires a...

https://ljvmiranda921.github.io/notebook/2023/05/01/peft/

HuahuiYi commented 1 year ago

Thank you for your excellent summary of PEFT. By the way, may I ask what software you used for drawing the diagrams?

ljvmiranda921 commented 1 year ago

Hi @HuahuiYi , thanks for the kind words. I use Figma for drawing the diagrams. I tried to make it look "stylistically" like it was drawn via LaTeX/TikZ, so I'm using simple boxes and gradients + the Computer Modern font.

HuahuiYi commented 1 year ago

Hi @HuahuiYi , thanks for the kind words. I use Figma for drawing the diagrams. I tried to make it look "stylistically" like it was drawn via LaTeX/TikZ, so I'm using simple boxes and gradients + the Computer Modern font.

I really like the drawing style in the article, thank you for selflessly sharing it with me.