search

csabaiBio / elte_ml_journal_club

Machine learning journal club
https://csabaibio.github.io/elte_ml_journal_club/
6 stars 0 forks source link

2023.05.25. #129

Closed bbeatrix closed 1 year ago

bbeatrix commented 1 year ago

Dear All,

We plan to have journal club on Thursday again from 16:00 in person at ELTE 5.128 and online on this meet link: https://meet.google.com/fvd-soiu-ent. If you would like to present something, please let us know by commenting under this issue.

Best wishes, Bea

ozkilim commented 1 year ago

Saw this yesterday:https://arxiv.org/pdf/2305.10601.pdf

https://www.youtube.com/watch?v=ut5kp56wW_4&ab_channel=YannicKilcher

Language model promoting for better results. Seems pretty interesting. Can gloss over the idea but wont have time to go into details!

bbeatrix commented 1 year ago

Here are the references on the low-rank adaptation of large language models that I mentioned:

  1. LoRA: Low-Rank Adaptation of Large Language Models https://arxiv.org/pdf/2106.09685.pdf (2021)
  2. QLoRA: Efficient Finetuning of Quantized LLMs https://arxiv.org/abs/2305.14314 (2023)