ytyz1307zzh / Auto-Instruct

Code repo for EMNLP 2023 paper "Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models"
18 stars 2 forks source link

Instruction generation open-sourced. #2

Open txy77 opened 11 months ago

txy77 commented 11 months ago

Hello, I am very interested in your work. Regarding the instruction generation part in section 4.1, I would like to ask if the instructions generated using the black-box LLM can be made public? I would be very grateful for your reply to my question.

ytyz1307zzh commented 11 months ago

Hello,

Thank you for the interest! I have uploaded the meta-prompt templates (GPT-3/optimization/instruction_generation_templates) and the NIV2 tasks (data/niv2_english) to the repo. The following scripts can be used for instruction generation:

GPT-3/optimization/instruction/generation/formulate_meta_prompt.py: This scripts creates the meta-prompt for each task based on the meta-prompt templates in GPT-3/optimization/instruction_generation_templates, using the seed instruction and demonstration examples for each task. GPT-3/optimization/instruction/generation/gpt3_instruction_generation.py: This scripts generates the candidate instructions for each task, with meta-prompts as input.

Hope these helps!

txy77 commented 11 months ago

I was wondering if you could open-source all the generated instructions.

txy77 commented 10 months ago

Can you open-source all the generated instructions after executing the Python code above?