search

rmihaylov / mpttune

Tune MPTs
Apache License 2.0
84 stars 16 forks source link

support for MPT- 30b #11

Open imthebilliejoe opened 1 year ago

imthebilliejoe commented 1 year ago

Hi there,

can you please add support for mpt30b on single A100? thank you.

creatorrr commented 1 year ago

@rmihaylov would mpttune work for mpt-30b series out of the box?

pydaxing commented 1 year ago

mpt-30b can be finetuned by modifing the code, it's not difficult