currently the examples under references only support default datatype (float32), can we support a argument like --data-type to allow user to specify the datatype for the model?
Motivation, pitch
Many users like us always need to run different dataytpye for the model. like float16 and bfloat16. If this argument can be added, it will save many efforts.
🚀 The feature
currently the examples under references only support default datatype (float32), can we support a argument like --data-type to allow user to specify the datatype for the model?
Motivation, pitch
Many users like us always need to run different dataytpye for the model. like float16 and bfloat16. If this argument can be added, it will save many efforts.
Alternatives
No response
Additional context
No response