search

datawhalechina / self-llm

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合中国宝宝的部署教程
Apache License 2.0
9.77k stars 1.13k forks source link

2 warnings: MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization") / kernel version 4.18.0 #152

Open x6p2n9q8a4 opened 5 months ago

x6p2n9q8a4 commented 5 months ago

anaconda3/envs/alpaca-lora/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:316: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

Detected kernel version 4.18.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.

KMnO4-zx commented 5 months ago

请详细描述你的问题：