Add a CPU nbit to float dequantization op that supports torch.quintMxN type and QuantizedCPU backend - Githubissues

pytorch / FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

Other

1.17k stars 474 forks source link

Add a CPU nbit to float dequantization op that supports torch.quintMxN type and QuantizedCPU backend #2995

Closed excelle08 closed 3 weeks ago

excelle08 commented 4 weeks ago

Summary: Add a CPU nbit to float dequantization operator torch.ops.fbgemm.FusedNBitRowwiseQuantizedSBHalfFrontToFloat to support dequantization of int4 / int2 tensors which are of torch.quintMxN dtype and QuantizedCPU backend. This is to support D61305982

Differential Revision: D61305979

netlify[bot] commented 4 weeks ago

Deploy Preview for pytorch-fbgemm-docs ready!

Name	Link
Latest commit	ec379508688e2cda07e7241378c459dbb5dfd697
Latest deploy log	https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66c7a78f874f9d000899f66c
Deploy Preview	https://deploy-preview-2995--pytorch-fbgemm-docs.netlify.app
Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

facebook-github-bot commented 4 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 4 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 4 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 4 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 4 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request was exported from Phabricator. Differential Revision: D61305979

facebook-github-bot commented 3 weeks ago

This pull request has been merged in pytorch/FBGEMM@986e80c40dddcfa5ba198b24682e94fb1f0c162d.