kbressem / medAlpaca

LLM finetuned for medical question answering
GNU General Public License v3.0
484 stars 56 forks source link

Release Model? #12

Closed xqymain closed 1 year ago

xqymain commented 1 year ago

Will you make MedAlpaca 13b model publicly available, and the possible 30b?Its performance has me excited.

kbressem commented 1 year ago

13b is available, I forgot to make it public. 30b is difficult as we are currently unable to train it. I will try to rewrite the training using HF accelerate, hoping this will allows more efficient parallelization but it will take a few days.