Tuning for 405B/70B Prefill with small seqlen

pytorch / FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

Other

1.2k stars 494 forks source link

Closed zjing14 closed 2 months ago

zjing14 commented 2 months ago

Summary:

Differential Revision: D61802237

netlify[bot] commented 2 months ago

Name	Link
Latest commit	fbbdae905f13e028019ce20076f0b299973520df
Latest deploy log	https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66ce0ff73d3d5d0008d1af65
Deploy Preview	https://deploy-preview-3042--pytorch-fbgemm-docs.netlify.app
Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request was exported from Phabricator. Differential Revision: D61802237

facebook-github-bot commented 2 months ago

This pull request has been merged in pytorch/FBGEMM@3201870641abf0c7bfc5b7fbe000c433797123ca.