search

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
BSD 3-Clause "New" or "Revised" License
5.68k stars 514 forks source link

Support Llama-3.1-405B #199

Closed yanboliang closed 2 months ago

yanboliang commented 2 months ago

Screenshot 2024-09-04 at 4 03 23 PM