Check PyTorch version - Githubissues

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD 3-Clause "New" or "Revised" License

5.36k stars 485 forks source link

Open yifuwang opened 6 months ago

yifuwang commented 6 months ago

Stack from ghstack (oldest at bottom):

When the installed PyTorch version is not nightly:

Issue an warning if torch.compile is requested.
Raise an error if both tensor-parallel and torch.compile are requested (tensor-parallel + torch.compile doesn't work on 2.1.2+cu121 due to a bug in functional collective. See https://github.com/pytorch-labs/gpt-fast/issues/64)