search

johnsmith0031 / alpaca_lora_4bit

MIT License
533 stars 84 forks source link

what is the difference between v1 model and v2 model? #111

Open zlh1992 opened 1 year ago

zlh1992 commented 1 year ago

confusion with the setting:

V2 model support

parser_training.add_argument("--groupsize", type=int, default=-1, help="Groupsize of v2 model") parser_training.add_argument("--v1", action="store_true", help="Use V1 model")

what is the difference between v1 model and v2 model? and where is the different weights of them in huggingface models?

johnsmith0031 commented 1 year ago

v1 model is the model without group size (the first type of gptq model)