hqq_aten package not installed.

dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

MIT License

2.28k stars 223 forks source link

hqq_aten package not installed. #21

Closed LeMoussel closed 6 months ago

LeMoussel commented 6 months ago

When I execute the notebook demo.ipynb, I got hqq_aten package not installed. HQQBackend.ATEN backend will not work unless you install the hqq_aten lib in hqq/kernels.

What does it mean? What should be installed?

dvmazur commented 6 months ago

Hey, @LeMoussel! This is a warning and does not affect the notebook's execution in any way. Moreover, hqq_aten is not needed as we have custom kernels for HQQ inference.