search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
481 stars 145 forks source link

ability to load `.pt` file into the student model #403

Closed daspartho closed 11 months ago

daspartho commented 11 months ago

closes #402

added a flag small_model to the client.load_finetune method to specify loading the .pt file between the teacher model or the student model

# loads the .pt file into the teacher model by default
client.load_finetune(model_filename)

# loads the .pt file into the student model when `small_model` flag is set to `True`
client.load_finetune(model_filename, small_model=True)

this allows for existing code to still work without breaking

cc: @VictorOdede @abhigya-sodani