xvyaward / owq

Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models".
https://arxiv.org/abs/2306.02272
53 stars 5 forks source link

model_config.json #4

Open dorsa-zeinali opened 2 months ago

dorsa-zeinali commented 2 months ago

Hi, I hope you are doing well. I was wondering, how is the model_config.json file that is in the repo generated and what information does it store?

Thank you!

dorsa-zeinali commented 2 months ago

that model_config.json file contains the metas. im wondering how these metas are created