How was openchat/openchat-3.5-0106-gemma created?

imoneoi / openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

https://openchat.team

Apache License 2.0

5.26k stars 399 forks source link

Open houghtonweihu opened 8 months ago

NeonBohdan commented 8 months ago

Your model solves a lot of problems of gemma-7b-it (With it's tokenizer it's great for Ukrainian)

Can you please do the same for 2b one It's very interesting size

Hope it's not take a lot of Your time

samuelazran commented 8 months ago

I'm also wondering if it is full weights fine tuned or Lora fine tuned of Gemma? Any public info on the training of it?