Closed samos123 closed 1 year ago
Seem each Model will have different target modules, so need to come up with a way to detect the target modules automatically.
Edit: a better approach would be to let peft automatically detect it: https://github.com/huggingface/peft/issues/758#issuecomment-1655533476
Fallback if auto detection doesn't work:
Looks like by parsing config.json we should be able to dynamically detect the correct target modules: https://huggingface.co/meta-llama/Llama-2-7b-hf/blob/main/pytorch_model.bin.index.json