I would like to change the precision used in DLRM inference. I observed that the default datatype used in the original code is "float32", in the create_emb() method. Is changing the dtype to any of the supported values enough to correctly change the precision?
I believe that the generated embedding table would be directly used in the apply_emb() function.
Hello,
I would like to change the precision used in DLRM inference. I observed that the default datatype used in the original code is "float32", in the create_emb() method. Is changing the dtype to any of the supported values enough to correctly change the precision?
I believe that the generated embedding table would be directly used in the apply_emb() function.
Thanks for the help. Rishabh Jain