Open prinshul opened 10 months ago
Hi
The repo mentions use of Deepspeed to get quantized model sizes.
Can you please detail how it can be used to get the size.
Thanks.
Looking forward to the reply too.
Hi
The repo mentions use of Deepspeed to get quantized model sizes.
Can you please detail how it can be used to get the size.
Thanks.