microsoft / torchscale

Foundation Architecture for (M)LLMs
https://aka.ms/GeneralAI
MIT License
2.98k stars 201 forks source link

pip package does not contain RetNet #67

Closed fabienGenhealth closed 9 months ago

fabienGenhealth commented 10 months ago

The latest release 0.2.0 is from March (see https://pypi.org/project/torchscale/#history), predating the introduction of RetNet in this repo. As such the README is misleading since it is not possible to create a RetNet model with a pip install. When is the next release planned?

donglixp commented 10 months ago

Thanks for reporting the issue. We will fix it.

shumingma commented 9 months ago

We have released 0.3.0 (https://pypi.org/project/torchscale/). The problem is supposed to be fixed. Please try. Thanks!