Open dangokuson opened 3 days ago
You can find the output model path in footprint.json. I had a PR open for copying output model to output_dir: https://github.com/microsoft/Olive/pull/1430. Once the PR got merged, you can pull the main branch and run the optimization again.
@xiaoyu-work So, I have to compare their accuracy and pick the best model, or use the last one?
Describe the bug I tried to optimize BERT model with bert_ptq_cpu.json but it gave 7 output models. It there any ways or change the config to get only one output model?
To Reproduce
Expected behavior A clear and concise description of what you expected to happen.
Olive config Olive configurations here: https://github.com/microsoft/Olive/blob/main/examples/bert/bert_ptq_cpu.json
Olive logs Add logs here.
Other information
Additional context