search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
474 stars 151 forks source link

Set up instruction fine-tuning pipeline #315

Open VictorOdede opened 11 months ago

VictorOdede commented 11 months ago

it would be great to enable users to easily fine-tune base models for their unique downstream tasks

mmirman commented 10 months ago

We need some clarification on this! Maybe some roadmapping! Maybe a roadmapping meeting!

Aryan8912 commented 10 months ago

give some more details so I can work on this issue

Aakashdeep-Srivastava commented 10 months ago

i know this assign it to me

Aakashdeep-Srivastava commented 10 months ago

assign it as quickly as possible

bilal-aamer commented 10 months ago

@Aakashdeep-Srivastava can't assign tickets yet, kindly refer :https://discord.com/channels/1075227138766147656/1147542772824408074/1147672307544899584

lucylililiwang commented 6 months ago

Hi, can I also please work on this issues? Thank you!

lucylililiwang commented 6 months ago

Hi, I came up with an basic blue print. ![Uploading im1.PNG…]()

lucylililiwang commented 6 months ago

project_directory/ │ ├── data/ │ ├── dataset.csv │ └── preprocessing_script.py │ ├── models/ │ ├── fine_tuning_script.py │ └── evaluation_script.py │ ├── requirements.txt └── README.md

lucylililiwang commented 6 months ago

https://github.com/lucylililiwang/LLM-VM/blob/lucylililiwang-Set-up-instruction-fine-tuning-pipeline/preprocessing_script.py