LAION-AI / Open-Instruction-Generalist

Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
Apache License 2.0
206 stars 19 forks source link

Flan V2 #10

Open ari9dam opened 1 year ago

ari9dam commented 1 year ago

Do you have the FLAN V2 dataset as part of the 44M instructions? Which files from the https://huggingface.co/datasets/laion/OIG/tree/main should I take to access the zero shot portion of the FLAN V2. Thank you.

huu4ontocord commented 1 year ago

@LorrinWWW - can you answer @ari9dam - was it flanv2 or v1? you can look in the repo, it's called unified_flan.jsonl https://huggingface.co/datasets/laion/OIG/tree/main

It's a very basic conversion to instruciton.

switiz commented 1 year ago

same question... flan source from v1 or v2?