pytorch / FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
Other
1.2k stars 494 forks source link

Tuning for 405B/70B Prefill with small seqlen #3042

Closed zjing14 closed 2 months ago

zjing14 commented 2 months ago

Summary:

Differential Revision: D61802237

netlify[bot] commented 2 months ago

Deploy Preview for pytorch-fbgemm-docs ready!

Name Link
Latest commit fbbdae905f13e028019ce20076f0b299973520df
Latest deploy log https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66ce0ff73d3d5d0008d1af65
Deploy Preview https://deploy-preview-3042--pytorch-fbgemm-docs.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request has been merged in pytorch/FBGEMM@3201870641abf0c7bfc5b7fbe000c433797123ca.