search

jondurbin / airoboros

Customizable implementation of the self-instruct paper.
Apache License 2.0
1.02k stars 71 forks source link

May I ask that if there would be a llama2 based version for next step? #11

Closed aetherwu closed 1 year ago

aetherwu commented 1 year ago

It is excellent and I was amazed by its capabilities. Would llama2 increase its ability?

jondurbin commented 1 year ago

I published the llama-2 version of the 1.4.1 datasets on huggingface this morning, and TheBloke is quantizing right now.

The airboros-2.0 dataset and corresponding llama-2 models will be available within a week or two.

aetherwu commented 1 year ago

I published the llama-2 version of the 1.4.1 datasets on huggingface this morning, and TheBloke is quantizing right now.

The airboros-2.0 dataset and corresponding llama-2 models will be available within a week or two.

I've got it: https://huggingface.co/TheBloke/airoboros-l2-13B-gpt4-1.4.1-GPTQ Thanks.

30B version depends on Meta now :(