search

pytorch / pytorch.github.io

The website for PyTorch
https://pytorch.org
BSD 3-Clause "New" or "Revised" License
215 stars 280 forks source link

Added blog post "INT4 Decoding GQA CUDA Optimizations for LLM Inference" #1648

Closed cjyabraham closed 1 month ago

netlify[bot] commented 1 month ago

Deploy Preview for pytorch-dot-org-preview processing.

Name Link
Latest commit 5b50b49af8aee6f3a4733ed0247c0709dba614b1
Latest deploy log https://app.netlify.com/sites/pytorch-dot-org-preview/deploys/666170adf752f70008801f72