How can we resolve this warning?

AGI-Edgerunners / LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

https://arxiv.org/abs/2304.01933

Apache License 2.0

1.05k stars 99 forks source link

Closed noob-ctrl closed 1 year ago

noob-ctrl commented 1 year ago

When I use it, the following warning message appears：

UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization

How could I resolve this?

HZQ950419 commented 1 year ago

Hi, We will get this warning when we load int8 model and train the adapters. And this warning will not affect the performance.