AttributeError: 'NoneType' object has no attribute 'int4WeightExtractionHalf'

[JR-s763]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

Is this a model check point for proper loading or an int4 issue, has anyone encountered it?

Expected Behavior

none

Steps To Reproduce

none

Environment

- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :

Anything else?

none

[eric-0x72]

any solution?

[JR-s763]

Yes,make sure you have executed "pip install -r requirements.txt"

[eric-0x72]

pip install cpm_kernels