search

okuvshynov / slowllama

Finetune llama2-70b and codellama on MacBook Air without quantization
MIT License
448 stars 34 forks source link

Fp16 #4

Closed okuvshynov closed 1 year ago

okuvshynov commented 1 year ago
  1. Extract parameters to conf files.
  2. Support fp16 for storage and evaluation.